About
View my resumé.
- PhD in Computer Science at George Mason University
- Worked at SAGE lab led by Dr. Kevin Moran
- Doctoral Research focus Automated Software Engineering via Multimodal AI
- 5+ years of professional software engineering experience
- Publication track record in top-tier SWE venues
Interests
- Software Engineering
- Human Computer Interaction (HCI)
- Machine Learning
- Generative AI
- Large Language Model (LLM)
Education
PhD in CS, 2026
George Mason University
MS in CS, 2023
George Mason University
BS in CS, 2007
Shah Jalal University of Science & Technology, Bangladesh
Tech Skills
- Programming: Python, Javascript, Java, C
- Databases: MySQL, MongoDB, Redis, Elasticsearch, SQLite
- Libraries: OpenCV, NumPy, Matplotlib, Pandas, Socket.IO
- ML/DL/NLP: LLM (prompting, finetuning), PyTorch, Hugging Face, LangChain, scikit‐learn, spaCy
- Backend/Cloud/DevOps: Node.js, Express.js, REST API, AWS, Docker, Git
Experience
Assistant Professor, Computer Science
Stephen F. Austin State University
- Teach undergraduate courses in Computer Programming Principles and Object-Oriented Programming Methods, emphasizing Java programming, computational thinking, and software development.
- Design and deliver lectures, coding demonstrations, programming assignments, projects, quizzes, and examinations aligned with course learning outcomes.
- Develop hands-on programming activities and projects to strengthen students’ algorithmic thinking, problem-solving, debugging, and software development skills.
- Assess student learning through programming assignments, projects, quizzes, examinations, and individualized feedback.
- Mentor and support students through office hours and one-on-one guidance on programming concepts, debugging, and software development practices.
Graduate Research Assistant
SAGE Lab
- Major areas of contribution: Software Documentation, Ethical Software Design, Software Accessibility.
- Currently leading the project MultiC2C, to investigate on multimodal-LLMs capabilities in capturing UI semantics for code summarization.
- Designed and developed the overall architecture of AidUI, an automated approach to detect and localize deceptive design patterns on UIs.
- Prototyped the Semantic Text Matching component of MotorEase, an approach to detect motor‑impairment accessibility violations in app UIs.
- Collaborated in developing datasets to serve as benchmarks for Software Evolution, Bug Reporting and Bug Localization.
Graduate Teaching Assistant
Dept. of Computer Science
- Conducted lab sessions, mentored students, graded assignments, and proctored exams.
- Courses: Python Programming, Database, Computer Vision, Formal Methods.
Software Engineer
Ice9 Ltd.
- Member of the core engineering team responsible for the development and maintenance of SMASHBOARD.CO, a social CRM product.
- Collaborated with the technical lead on strategic planning and decision‑making for architecture design, development, testing and deployment.
- Lead the development and integration of social media query management and analytics module for INSTAGRAM.
- Optimized database and implemented master-replica architecture to resolve the synchronization delay of real time social media queries.
- Collaborated in implementing the migration of the core product from Rackspace to AWS.
Software Engineer
Synchronous ICT
- Lead the team to develop user management, search and notification platforms of project COMX, an in‑house application framework.
- Assessed team’s capacity to deliver, formed sprints and released duration based development milestones.
- Established standard software engineering practices like version controlling, issue and project tracking.
- Documented technical specifications and maintained all reports pertaining to the development process.
Software Engineer
Dcastalia
- Developed and published HE BUSINESS MANAGER, a native Android app for inventory management of healthcare products.
- Collaborated with the backend team on requirements analysis, architecture design, development, testing and deployment.
Student Intern
Mercedes‑Benz Group AG (former Daimler AG)
- Developed a KVP (key‑value pair) parser to convert the unstructured stream of environment perception data into a canonical form.
System Engineer
Grameenphone Ltd
- Member of the transmission network configuration and optimization team to serve over 20 million mobile users.
- Analysed detected alarms, classified probable causes, and fixed or escalated issues to the concerned stakeholders.
Publications
(2023).
GUIEvo: Automated Evolution of Mobile Application GUIs from Mockups.
In The 21st International Conference on Mining Software Repositories (MSR 2024), Lisbon, Portugal, April 15th-16th, 2024.
(2023).
MotorEase: Automated Detection of Motor Impairment Accessibility Issues in Mobile App UIs.
In The 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024), Lisbon, Portugal, April 14th-20th, 2024.
(2023).
On Using GUI Interaction Data to Improve Text Retrieval-based Bug Localization.
In The 46th IEEE/ACM International Conference on Software Engineering (ICSE 2024), Lisbon, Portugal, April 14th-20th, 2024.
(2023).
Toward Automated Tools to Support Ethical GUI Design.
In The 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023) Companion Proceedings (ICSE-Companion), Melbourne, Australia, May 14th-20th, 2023.
(2022).
AidUI: Toward Automated Recognition of Dark Patterns in User Interfaces.
In The 45th IEEE/ACM International Conference on Software Engineering (ICSE 2023), Melbourne, Australia, May 14th-20th, 2023.
(2021).
AndroR2: A Dataset of Manually Reproduced Bug Reports for Android Applications.
In 2021 IEEE/ACM 18th International Conference on Mining Software Repositories (MSR'21), Data Showcase Track, Virtual (originally Madrid, Spain), May 17th - 19th, 2021.
Selected Research
Multimodal Code Summarization
Principal Contributor
- Goal: To investigate on Multimodal‑LLMs capabilities in capturing UI semantics for code summarization.
- Automated the data extraction pipeline to collect and map multi-modal data (code, comment, UI) from open-source app repositories.
- Lead the team to develop ground truth code summaries by augmenting UI information.
- Formulated the design of experiments that include different prompt techniques, input modalities and LLMs.
- Developed the pipeline for both lexical and semantic similarity based quantitative evaluation.
AidUI
Principal Contributor
- paper link, project repo
- AidUI is an automated approach to detect and localize deceptive design patterns on UIs.
- Developed a unified taxonomy and a set of heuristic rules to detect visual‑textual cues that signify the presence of deceptive UI design patterns.
- Automated the data pipeline to extract UIs from publicly available app usage videos and screenshots by prior studies.
- Designed and developed an approach that leverages computer vision and NLP techniques to detect different deceptive patterns on UI.
- Implemented an automated evaluation pipeline. Dockerized and published research artifacts in a public repository.
MotorEase
Co-Contributor
- paper link, project repo
- MotorEase is an approach to detect motor‑impairment accessibility violations in app UIs.
- Developed the initial prototype of the “Semantic Text Matching” component of the automated approach.
- Collaborated with the lead contributor on labeling and curation of the dataset.
Selected Open Source Projects
Drishtipat
Implementation of different concepts/topics of Computer Vision.
Ontorjal
Implementation of DNS client & Distance Vector Routing protocol.
Tasky
A backend boilerplate featuring Role Based Access Control, Searching, Token Authentication, TDD.
Awards
NSF Travel Award for ICSE'23
Best Poster Presentation Award
Summer Research Initiation Award
National Education Board Scholarship
National Education Board Scholarship
Professional Services
- Junior PC Member:
- International Conference on Mining Software Repositories (MSR) 2024
- Co-Reviewer:
- International Conference on Mining Software Repositories (MSR) 2022
- External Reviewer:
- International Conference on Software Engineering (ICSE) 2023, 2021
- International Conference on Software Analysis, Evolution and Reengineering (SANER) 2023, 2022
- International Conference on Automated Software Engineering (ASE) 2022
- International Conference on Mining Software Repositories (MSR) 2021
- International Conference on Program Comprehension (ICPC) 2021
Volunteering
Co Mentor at Aspiring Scientists Summer Internship Program
George Mason University
- Mentored one high school intern in dataset preparation for the software accessibility project
Director, Web Services
Bangladeshi Graduate Students Association (BDGSA), GMU
- Acted as a member of the admin panel to maintain BDGSA’s social media platform
- Actively participated in arranging various social events
General Member
KIN, Shah Jalal University of Science & Technology
- Arranged several campaigns to collect & distribute winter clothes among homeless & poor people. Volunteered in free blood donation programs
Contact
- smhasanmansur@gmail.com, SM.Hasan.Mansur@sfasu.edu