Enricommender: Business Intelligence for User Interface Design

Graphical User Interfaces; Comparative analysis; Business intelligence; Human-centered computing; Systems and tools for interaction design.; Information Systems

Abstract :

[en] Graphical user interface (GUI) browsing and retrieval tools are becoming essential to interaction design research and practice. These tools allow GUI designers to browse large amounts of data and recover inspiring or relevant designs for their task. Unfortunately, data-driven market analysis or business intelligence (BI) applied to GUIs have mostly been left aside. To address this research gap, we elicit designers’ needs and responses regarding the development of Enricommender, a high-fidelity prototype of a market analysis recommender and reporting system. We identify and discuss key design challenges, as reported by more than 200 real-world designers, as well as their workflows and overall expectations towards such a BI system. Ultimately, this article sets the foundation for developing future GUI-oriented BI applications. RESEARCH HIGHLIGHTS Insights about ideation and design of graphical user interfaces. Elicited preferences and current practices from 200 real-world designers. A business intelligence prototype for comparative analysis and design recommendations.

Disciplines :

Computer science

Author, co-author :

CIARRONE, Alexis

LEIVA, Luis A. ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

DUBIEL, Mateusz ; University of Luxembourg > Faculty of Science, Technology and Medicine (FSTM) > Department of Computer Science (DCS)

External co-authors :

Language :

English

Title :

Enricommender: Business Intelligence for User Interface Design

Publication date :

22 August 2024

Journal title :

Interacting with Computers

ISSN :

0953-5438

eISSN :

1873-7951

Publisher :

Oxford University Press (OUP)

Peer reviewed :

Peer Reviewed verified by ORBi

Focus Area :

Computational Sciences

European Projects :

HE - 101071147 - SYMBIOTIK - Context-aware adaptive visualizations for critical decision making

FnR Project :

FNR15722813 - Brainsourcing For Affective Attention Estimation, 2021 (01/02/2022-31/01/2025) - Luis Leiva

Funders :

UE - Union Européenne

Funding text :

This research is supported by the Horizon 2020 FET program of the European Union through the ERA-NET Cofund funding (project BANANA, grant CHIST-ERA-20-BCI-001) and Horizon Europe’s European Innovation Council through the Pathfinder program (SYMBIOTIK project, grant 101071147).

Available on ORBilu :

since 30 August 2024

Statistics

Number of views

111 (11 by Unilu)

Number of downloads

147 (13 by Unilu)

More statistics

Scopus citations^®

Scopus citations^®
without self-citations

OpenCitations

OpenAlex citations

WoS citations^™

Bibliography

Bunian, S., Li, K., Jemmali, C., Harteveld, C., Fu, Y., and El-Nasr, M. S. (2021). VINS: Visual Search for Mobile User Interface Design. In Proc of the 2021 CHI Conf. on Human Factors in Computing Systems, pp. 1–15. Yokohama, Japan.
Arens, Y., Miller, L., Shapiro, S., and Sondheimer, N. (1988). Automatic Construction of User-Interface Displays. In Proceedings of the 7th AMI Conference, St. Paul, MN.
Deka, B., Huang, Z., Franzen, C., Hibschman, J., Afergan, D., Li, Y., Nichols, J. and Kumar, R. (2017) Rico: a mobile app dataset for building data-driven design applications. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology, pp. 845–854. Canada. ACM, Québec City QC.
Eisenstein, J., Vanderdonckt, J., and Puerta, A. (2002). Applying Model-Based Techniques to the Development of UIs for Mobile Computers. In Proceedings of the 6th International Conference on Intelligent User Interfaces, pp. 69–76. USA, San Francisco, CA.
Hashimoto, Y. and Igarashi, T. (2005). Retrieving Web Page Layouts using Sketches to Support Example-based Web Design. In 2nd Eurographics Workshop on Sketch-Based Interfaces and Modeling, pp. 155–164. Dublin, Ireland.
Bonnardel, N. (1999) Creativity in design activities: The role of analogies in a constrained cognitive environment. In Proc. of the 3rd conf. on creativity and cognition - C & C’99, pp. 158–165. United Kingdom. ACM Press, Loughborough.
Gonçalves, M., Cardoso, C. and Badke-Schaub, P. (2014) What inspires designers? Preferences on inspirational approaches during idea generation. Design Stud., 35, 29–53. https://doi.org/10.1016/j.destud.2013.09.001.
Herring, S. R., Chang, C.-C., Krantzler, J. and Bailey, B. P. (2009) Getting inspired!: Understanding how and why examples are used in creative design practice. In Proc. of the SIGCHI conf. on human factors in computing systems, pp. 87–96. USA. ACM, Boston MA.
Koch, J., László, M., Lucero, A. and Oulasvirta, A. (2018) Surfing for inspiration: Digital inspirational material in design practice. In Design Research Society Conference 2018.
Leiva, L. A., Hota, A. and Oulasvirta, A. (2020b) Interactive exploration of large-scale UI datasets with design maps. Interact. Comput., 32, 490–509. https://doi.org/10.1093/iwcomp/iwab006.
Vasconcelos, L. A. and Crilly, N. (2016) Inspiration and fixation: Questions, methods, findings, and challenges. Design Stud., 42, 1–32. https://doi.org/10.1016/j.destud.2015.11.001.
Swearngin, A., Dontcheva, M., Li, W., Brandt, J., Dixon, M. and Ko, A. J. (2018) Rewire: Interface design assistance from examples. In Proc. of the 2018 CHI conf. on human factors in computing systems, pp. 1–12. ACM, Montreal QC Canada.
Wallace, S., Le, B., Leiva, L. A., Haq, A., Kintisch, A., Bufrem, G., Chang, L. and Huang, J. (2020) Sketchy: Drawing Inspiration from the Crowd. Proc. of the ACM on human-computer interaction, 4, 1–27. https://doi.org/10.1145/3415243.
Ritchie, D., Kejriwal, A. A. and Klemmer, S. R. (2011) D.tour: Style-based exploration of design example galleries. In Proc. of the 24th annual ACM symposium on user interface software and technology, pp. 165–174. ACM, Santa Barbara California USA.
Deka, B., Huang, Z. and Kumar, R. (2016) ERICA: Interaction mining mobile apps. In Proc. of the 29th annual symposium on user interface software and technology, pp. 767–776. Japan. ACM, Tokyo.
Eckert, C. and Stacey, M. (2000) Sources of inspiration: A language of design. Design Stud., 21, 523–538.
Sharmin, M., Bailey, B. P., Coats, C. and Hamilton, K. (2009) Understanding knowledge management practices for early design activity and its implications for reuse. In Proc. of the SIGCHI conf. on human factors in computing systems, CHI’09, pp. 2367–2376. USA. Association for Computing Machinery, New York, NY.
Perttula, M. and Sipilä, P. (2007) The idea exposure paradigm in design idea generation. J. Eng. Des., 18, 93–102. https://doi.org/10.1080/09544820600679679.
Chan, J., Siangliulue, P., Qori McDonald, D., Liu, R., Moradinezhad, R., Aman, S., Solovey, E. T., Gajos, K. Z. and Dow, S. P. (2017) Semantically far inspirations considered harmful? Accounting for cognitive states in collaborative ideation. In Proc. of the 2017 ACM SIGCHI conf. on creativity and cognition, C & C’17, pp. 93–105. Association for Computing Machinery, New York, NY, USA.
Huang, F., Canny, J. F. and Nichols, J. (2019) Swire: Sketch-based user interface retrieval. In Proc. of the 2019 CHI conf. on human factors in computing systems, pp. 1–10. ACM, Glasgow Scotland Uk.
Li, Y., He, J., Zhou, X., Zhang, Y., and Baldridge, J. (2020). Mapping Natural Language Instructions to Mobile UI Action Sequences. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 8198–8210. USA, Seattle, WA.
Leiva, L. A., Hota, A. and Oulasvirta, A. (2020a) Enrico: A dataset for topic modeling of mobile UI designs. In The 22nd international conf. on human-computer interaction with mobile devices and services, pp. 1–4. ACM, Oldenburg Germany.
Wang, B., Li, G., Zhou, X., Chen, Z., Grossman, T., and Li, Y. (2021). Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning. In The 34th Annual ACM Symposium on User Interface Software and Technology, pp. 498–510. Virtual Event, USA.
Inukollu, V. N., Keshamon, D. D., Kang, T. and Inukollu, M. (2014) Factors influencing quality of mobile apps: role of mobile app development life cycle. Int. J. Softw. Eng. Appl., 5, 15–34. https://doi.org/10.5121/ijsea.2014.5502.
Nilsson, E. G. (2009) Design patterns for user interface for mobile applications. Adv. Eng. Softw., 40, 1318–1328. https://doi.org/10.1016/j.advengsoft.2009.01.017.
Kumar, R., Satyanarayan, A., Torres, C., Lim, M., Ahmad, S., Klemmer, S. R. and Talton, J. O. (2013) Webzeitgeist: Design mining the web. In Proc. of the SIGCHI conf. on human factors in computing systems, pp. 3083–3092. France. ACM, Paris.
Todi, K., Leiva, L. A., Buschek, D., Tian, P. and Oulasvirta, A. (2021) Conversations with GUIs. In Designing interactive systems conf. 2021, pp. 1447–1457. Virtual Event USA. ACM.
Beltramelli, T. (2018). Pix2code: Generating Code from a Graphical User Interface Screenshot. In Proceedings of the ACM SIGCHI Symposium on Engineering Interactive Computing Systems, pp. 1–6, ACM, Paris, France.
Huang, F., Li, G., Zhou, X., Canny, J. F., and Li, Y. (2021). Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models. arXiv e-prints (2021): arXiv-2110.
Moran, K., Bernal-Cárdenas, C., Curcio, M., Bonett, R., and Poshyvanyk, D. (2018). Machine Learning-Based Prototyping of Graphical User Interfaces for Mobile Apps. IEEE Transactions on Software Engineering, 46, 196–221.
Li, T. J.-J., Popowski, L., Mitchell, T. M. and Myers, B. A. (2021) Screen2Vec: Semantic Embedding of GUI Screens and GUI Components. In Proc of the 2021 CHI conf. on human factors in computing systems, pp. 1–15.
Lee, P. and Sunder, M. (2016) The Law of Look and Feel. SSRN Electronic Journal. https://doi.org/10.2139/ssrn.2733780.
Fleckenstein, M. and Fellows, L. (2018). Modern Data Strategy. Springer, https://doi.org/10.1007/978-3-319-68993-7.
Mahanti, R. (2019) Data Quality: Dimensions, Measurement, Strategy, Management, and Governance. Quality Press.
Ballou, D. P. and Pazer, H. L. (1985) Modeling data and process quality in multi-input, multi-output information systems. Management Sci., 31, 150–162. https://doi.org/10.1287/mnsc.31.2.150.
Pipino, L., Lee, Y. and Wang, R. (2003) Data quality assessment. Commun. ACM, 45.
Voutilainen, J. P., Salonen, J. and Mikkonen, T. (2015) On the design of a responsive user interface for a multi-device web service. In The 2015 2nd ACM international conf. on mobile software engineering and systems, pp. 60–63.
Grudin, J. (1989) The case against user interface consistency. Commun. ACM, 32, 1164–1173.
Satzinger, J. W. and Olfman, L. (1998) User interface consistency across end-user applications: The effects on mental models. J. Manage. Inform. Syst., 14, 167–193. https://doi.org/10.1080/07421222.1998.11518190.
Romanenkova, J. (2020) You are not the customer. And here’s why.https://uxdesign.cc/you-are-not-the-customer-and-hereswhy-3aa94a6701fa.
Cao, H. H., Han, B., Hirshleifer, D. and Zhang, H. H. (2011) Fear of the unknown: familiarity and economic decisions. Rev. Fin., 15, 173–206. https://doi.org/10.1093/rof/rfp023.
Lee, C., Kim, S., Han, D., Yang, H., Park, Y.-W., Kwon, B. C., and Ko, S. (2020). GUIComp: A GUI Design Assistant with Real-Time, MultiFaceted Feedback. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, pp. 1–13. USA, Honolulu, HI.
Laudan, L. (1989) If it ain’t broke, don’t fix it. The British J. Philos. Sci., 40, 369–375. https://doi.org/10.1093/bjps/40.3.369.