Jieshan Chen

Short CV

Dr. Jieshan Chen is currently a research scientist and UI intelligence team lead at CSIRO’s Data61, Australia. She received her Ph.D. degree in computer science at Australian National University. She works at the interaction of software engineering and human computer interaction, using human-centred technique to examine and ensure responsible software development by design. Dr. Chen is currently working on dark pattern detection, data visualisation, UI design search and generation, and mobile application accessibility enhancement. She has published in various top-tier conferences and journals such as ICSE, ASE, FSE, UIST, CHI, TOSEM and USENIX Security.

Selected Awards

• 2024, CSIRO SCS Biannual Awards - Early Career in Science Award
• 2023, CSIRO SCS Biannual Awards - Women in Science Career Award
• 2020, SIGSOFT Distinguished Paper Award (ICSE2020)

Research Interests

Human-AI Interaction, Software Engineering, User Interface, LLM-Based Agents, Dark Pattern

Selected Publications

• Minh Duc Vu, Han Wang, Zhuang Li, Jieshan Chen, Shengdong Zhao, Zhenchang Xing, Chunyang Chen. GPTVoiceTasker: Advancing Multi-step Mobile Task Efficiency Through Dynamic Interface Exploration and Learning. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2024).
• Yu Cheng, Jieshan Chen*, Qing Huang, Zhenchang Xing, Xiwei Xu, Qinghua Lu. Prompt Sapper: A LLM-Empowered Production Tool for Building AI Chains. ACM Transactions on Software Engineering and Methodology (TOSEM 2023).
• Jieshan Chen, Jiamou Sun, Sidong Feng, Zhenchang Xing, Qinghua Lu, Xiwei Xu, Chunyang Chen. Unveiling the Tricks: Automated Detection of Dark Patterns in Mobile Applications. Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2023).
• Jieshan Chen, Mulong Xie, Zhenchang Xing, Chunyang Chen, Xiwei Xu, Liming Zhu and Guoqiang Li. Object Detection for Graphical User Interface: Old Fashioned or Deep Learning or a Combination?Proceedings of the ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE 2020).
• Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xiwei Xu, Liming Zhu, Guoqiang Li, and Jinshui Wang. Unblind Your Apps: Predicting Natural-Language Labels for Mobile GUI Components by Deep Learning. Proceedings of the ACM/IEEE International Conference on Software Engineering (ICSE 2020).
• Jieshan Chen, Chunyang Chen, Zhenchang Xing, Xin Xia, Liming Zhu, John Grundy, and Jinshui Wang. Wireframe-based UI Design Search through Image Autoencoder. ACM Transactions on Software Engineering and Methodology (TOSEM 2020).