Application of Computer Vision for Customer Insights: Demographics and Visit Duration in Coffee Shops

Faisal; Rachmat; Husna Saleh; Irfan; Muhammad As’ad

doi:10.54518/rh.5.5.2025.811

Authors

Faisal Universitas Pejuang Republik Indonesia, Indonesia
Rachmat Universitas Pejuang Republik Indonesia, Indonesia
Husna Saleh Institut Kesehatan dan Teknologi Graha Medika, Indonesia
Irfan Universitas Muhammadiyah Sinjai, Indonesia
Muhammad As’ad Institut Kesehatan dan Teknologi Buton Raya, Indonesia

DOI:

https://doi.org/10.54518/rh.5.5.2025.811

Keywords:

Coffee Shop Industry, Customer Analytics, Data-Driven Decision Making

Abstract

The coffee shop industry is increasingly competitive, requiring business owners to adopt data-driven strategies rather than rely solely on intuition, as traditional approaches such as surveys and manual observation are often subjective, time-consuming, and lack scalability. This study aims to design, implement, and evaluate an end-to-end intelligent system based on computer vision to automatically and non-intrusively analyze customer demographics (age and gender) and visit duration (dwell time). The proposed framework emphasizes both technical accuracy and privacy-by-design principles, where facial data is processed in real time without storage, and only anonymized metadata is utilized for business analysis. Using a simulated 60-minute test video containing 50 virtual customers with balanced gender, varied age groups, and predetermined visit durations, the system was evaluated and demonstrated strong performance, achieving 96% accuracy in gender classification, 89% in age group classification, and a Mean Absolute Error (MAE) of less than 45 seconds in dwell time measurement. The findings confirm that the ethical application of computer vision can provide valuable business insights, including the identification of demographic-based peak hours, the recognition of product preferences, and the optimization of spatial layouts, ultimately enabling coffee shops and SMEs to enhance competitiveness and profitability through data-driven decision-making.

Downloads

Download data is not yet available.

References

Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., ... & Zheng, X. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv preprint arXiv:16 (3).44-67.

Antipov, G., Baccouche, M., & Dugelay, J. L. (2017). Face aging with conditional generative adversarial networks. In 2017 IEEE international conference on image processing (ICIP) 7(2) 2089-2093.

Baig, M. R., Joseph, T. V., Sadvilkar, N., Silaparasetty, M. K., & So, A. (2020). The Deep Learning Workshop: Learn the skills you need to develop your own next-generation deep learning models with TensorFlow and Keras. Birmingham: Packt Publishing Ltd.

Bewley, A., Ge, Z., Ott, L., Ramos, F., & Upcroft, B. (2016). Simple online and realtime tracking. In 2016 IEEE international conference on image processing (ICIP) 3(2) 3464-3468.

Cavoukian, A. (2010). Privacy by design: the definitive workshop. Identity in the Information Society, 3(2), 247-251.

Chen, R., Perry, P., Boardman, R., & McCormick, H. (2022). Augmented reality in retail: a systematic review of research foci and future research agenda. International Journal of Retail & Distribution Management, 50(4), 498-518.

Chong, A. Y. L., Li, B., Ngai, E. W., Ch'Ng, E., & Lee, F. (2016). Predicting online product sales via online reviews, sentiments, and promotion strategies: A big data architecture and neural network approach. International Journal of Operations & Production Management, 36(4), 358-383.

Heaton, J. (2018). Ian goodfellow, yoshua bengio, and aaron courville: Deep learning: The mit press. Genetic programming and evolvable machines, 19(1), 305-307.

Hermina, T., & Fauziah, H. (2022). How does Implementation Drive Actual Buying Behavior of Organic Coffee?. Research Horizon, 2(4), 465-475.

Ismail, N., & Malik, O. A. (2022). Real-time visual inspection system for grading fruits using computer vision and deep learning techniques. Information Processing in Agriculture, 9(1), 24-37.

Kemmer, B., Simões, R., & Lima, C. (2022). Face aging using generative adversarial networks. In Generative adversarial learning: architectures and applications (pp. 145-168). Cham: Springer International Publishing.

Kumar, H. (2022). Augmented reality in online retailing: a systematic review and research agenda. International Journal of Retail & Distribution Management, 50(4), 537-559.

Kumar, R., Singh, K., Mahato, D. P., & Gupta, U. (2024). Face-based age and gender classification using deep learning model. Procedia Computer Science, 235(9), 2985-2995.

Limna, P., Siripipatthanakul, S., & Phayaphrom, B. (2021). The role of big data analytics in influencing artificial intelligence (AI) adoption for coffee shops in Krabi, Thailand. International Journal of Behavioral Analytics, 1(2), 1-17.

Nithya, R., Santhi, B., Manikandan, R., Rahimi, M., & Gandomi, A. H. (2022). Computer vision system for mango fruit defect detection using deep convolutional neural network. foods, 11(21), 3483-3490.

Pagallo, U. (2020). On the principle of privacy by design and its limits: Technology, ethics and the rule of law. In Italian Philosophy of Technology: Socio-Cultural, Legal, Scientific and Aesthetic Perspectives on Technology (pp. 111-127). Cham: Springer International Publishing.

Pandi, C., Adi Narayana Reddy, K., Alladi, R., Chandra Sekhar Reddy, V., & Sumithabhashini, P. (2022). Emotion and gender classification using convolution neural networks. In ICT Systems and Sustainability: Proceedings of ICT4SD 2021, Volume 1 (pp. 563-573). Singapore: Springer Nature Singapore.

Papadopoulos, D. (2021). Mothers’ experiences and challenges raising a child with autism spectrum disorder: A qualitative study. Brain sciences, 11(3), 309-315.

Richards, G., Yeoh, W., Chong, A. Y. L., & Popovič, A. (2019). Business intelligence effectiveness and corporate performance management: an empirical analysis. Journal of computer information systems, 59(2), 188-196.

Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., & Chen, L. C. (2018). Mobilenetv2: Inverted residuals and linear bottlenecks. In Proceedings of the IEEE conference on computer vision and pattern recognition 4(5), 4510-4520.

Seymour, M., Allen, S., Giallo, R., & Wood, C. E. (2022). ‘Dads kind of get forgotten’: the mental health support needs of fathers raising a child with Autism Spectrum Disorder. Journal of Family Studies, 28(4), 1199-1216.

Tang, Y. (2016). TF. Learn: TensorFlow’s high-level module for distributed machine learning. arXiv preprint arXiv:1(6), 12-51.

Vayadande, K., Deshpande, R., Deshpande, M., Chaudhary, P., Dhangar, A., & Dhangar, T. (2024). Tracking Barista Productivity and Customer Demographics. International Conference on Data Intelligence and Cognitive Informatics (ICDICI) 4(2), 891-898.

Veronica, N., Ramanda, D. K., & Perdhana, M. S. (2025). Literature Review on BRI Client’s Coffee Export and Competitive Advantage Through Sustainability. Economic and Business Horizon, 4(2), 401-414.

Wang, L. (2023, October). Faster R-CNN-based pedestrian detection and tracking. In Third International Conference on Advanced Algorithms and Signal Image Processing (AASIP 2023) 12(4), 1249-1256.

Watson, R. (2022). The virtual economy of the metaverse: Computer vision and deep learning algorithms, customer engagement tools, and behavioral predictive analytics. Linguistic and Philosophical Investigations, 2 (21), 41-56.

Wieder, B., & Ossimitz, M. L. (2015). The impact of Business Intelligence on the quality of decision making–a mediation model. Procedia computer science, 64(2), 1163-1171.

Wirsansky, E. (2020). Hands-On Genetic Algorithms with Python: Applying genetic algorithms to solve real-world deep learning and artificial intelligence problems. Birmingham: Packt Publishing Ltd.

Yang, B., Huang, C., & Nevatia, R. (2011, June). Learning affinities and dependencies for multi-target tracking using a CRF model. CVPR 2011 6 (5), 1233-1240.

Zhang, K., Zhang, Z., Li, Z., & Qiao, Y. (2016). Joint face detection and alignment using multitask cascaded convolutional networks. IEEE signal processing letters, 23(10), 1499-1503.

Zhichao Lu, Z., Deb, K., & Boddeti, V. N. (2020). MUXConv: Information multiplexing in convolutional neural networks. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition 6(7)12044-12053.

Zuo, H., Yang, Y., & Cao, L. (2022). Research of Pedestrian Object Tracking Algorithms. 2022 Global Conference on Robotics, Artificial Intelligence and Information Technology (GCRAIT) 2(6), 155-159.