IDEA

School of Information, University of Michigan Making programming accessible with every Intelligent Developer Experience.

Welcome

Welcome to the IDEA (Intelligent Developer Experiences for Accessibility) lab directed by Prof. Venkatesh Potluri at the School of Information, University of Michigan. We make developer tools and experiences accessible. We ensure that the human experiences we create using technology, and the tools that are used to create technology are accessible to people with disabilities. Learn more about our evolving mission, how we develop impactful “ideas”, and how we realize them.

Our mission

All of computing is human-facing at its core. Yet most human experiences interfaced by computing and digital technology exclude people with variations in ability. We believe that empowering people with disabilities with the right set of tools and opportunities to lead technology creation will naturally make technologies, and the human experiences they facilitate useful for and usable by everybody.

What do we do?

We investigate accessibility gaps experienced by people with disabilities that prevent them from building technology-powered human experiences. We design, develop, evaluate, and deploy IDEAs that increase access.

What are IDEAs?

An IDEA stands for Intelligent Developer Experience for Accessibility. We think of these as units of the impact we make on the world. IDEAs can take several forms; these could be deep qualitative and ethnographic investigations, large-scale data driven studies, design of prototype systems demonstrating new “programming” experiences, and deployment of real-world tools. Here are a few examples:

1. New interactions for accessible programming

2. Real-world systems to improve developer tools

CodeWalk, a set of features that we developed to make collaborative programming activities inclusive to BVI developers has been released as a set of features in VS Code LiveShare. The video segment below highlights this feature. This microsoft learn article details our audio design.

3. Qualitative and empirical investigations

Please refer to our publications for examples of qualitative and empirical investigations.

Flowchart describing accessibility heuristics for AI coding tools. On the left, there is an illustration of a computer terminal inside of a speech bubble, with an arrow on the right pointing right towards five boxes stacked on top of each other listing the following heuristics: H1 Agent Interface, H2 Agent Operation, H3 User Operation, H4 Help and Recovery, H5 Adaptability. To the right of the heuristics is another arrow pointing right towards two stacked bubbles. The top bubble is green and contains a white checkmark, and the bottom bubble is red and contains a white X

News

Aug 30, 2025 IDEA Lab will be at Assets! Shalini will be presenting a poster on accessibility guidelines for VibeCoding interfaces, Ellie will be presenting a paper on embroidered tactile graphics with her collaborators at UW, and Veronica will be presenting a poster on an auto-ethnographic account of a neurodivergent professional with her collaborators.
Jun 06, 2025 Kai Nylund will be presenting our paper on MatplotAlt at Eurovis2025!
Mar 12, 2025 Venkatesh presented about accessibility of flowcharts at the 40th CSUN Assistive Technology Conference with Brianna Wimer, Frank Elavsky, and Jennifer Mankoff.
Sep 30, 2024 Venkatesh Potluri shared his expertise on the accessibility of the research process at the Arxiv Accessibility Forum.

Members

Venkatesh Potluri
Assistant Professor of Information, University of Michigan
Ellie Seehorn
PhD Student in CSE (co-advised with Anhong Guo)
Shalini Madan
UMSI PhD Student
Akhila Joshi
UMSI Master's Student (thesis track)
Yushan Wei
Research Assistant

Alumni

Veronica Pimenova
PhD Student (co-advised with Dhruv Jain) (Sep 2025 - Sep 2026)
Sreelakshmi S B
Researcher, University of Michigan
Vidya Venkappa
Research Assistant
Alina Faisal
Student Research Assistant (Jun - Aug 2025)

Selected Publications

2026

  1. Three Modalities, Two Design Probes, One Prototype, and No Vision: Experience-Based Co-Design of a Multi-modal 3D Data Visualization Tool
    Sanchita S Kamath, Aziz N Zeidieh, Venkatesh Potluri, Sile O’Modhrain, Kenneth Perry, and 1 more author
    In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026
  2. TouchScribe: Augmenting Non-Visual Hand-Object Interactions with Automated Live Visual Descriptions
    Ruei-Che Chang, Rosiana Natalie, Wenqian Xu, Jovan Zheng Feng Yap, Tiange Luo, Venkatesh Potluri, and 1 more author
    In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, 2026
  3. RAVEN: Realtime Accessibility in Virtual ENvironments for Blind and Low-Vision People
    Xinyun Cao, Kexin Phyllis Ju, Chenglin Li, Venkatesh Potluri, and Dhruv Jain
    In Proceedings of the 2026 CHI Conference on Human Factors in Computing Systems, , 2026
  4. Vibe Check: Accessibility Heuristics for Vibe Coding Interfaces
    Shalini Madan, Sreelakshmi Surabiyil Bindu, and Venkatesh Potluri
    In Proceedings of the 23rd International Web for All Conference, Dubai, United Arab Emirates , 2026
  5. Bespoke Visual Assistance: What and How do Blind and Low-Vision People Create with Agentic Programming?
    Ellie Seehorn, Gene S-H Kim, Aziz Zeidieh, Ather Jammoa, Kunyeul Lee, Aditi Shah, Jaylin Herskovitz, Anhong Guo, and Venkatesh Potluri
    In Proceedings of the 28th International ACM SIGACCESS Conference on Computers and Accessibility, Vila Nova de Gaia, Portugal , 2026
  6. Reflections and Recommendations on AI Adoption Practice from a Mixed-Ability Research Group
    Shalini Madan, Sreelakshmi Surabiyil Bindu, Veronica Pimenova, Ellie Seehorn, and Venkatesh Potluri
    ASSETS 2026 Experience reports, 2026

2025

  1. MatplotAlt: A Python Library for Adding Alt Text to Matplotlib Figures in Computational Notebooks
    Kai Nylund, Jennifer Mankoff, and Venkatesh Potluri
    Computer Graphics Forum, 2025
  2. Demo of RAVEN: Realtime Accessibility in Virtual ENvironments for Blind and Low-Vision People
    Xinyun Cao, Kexin Phyllis Ju, Chenglin Li, Venkatesh Potluri, and Dhruv Jain
    2025
  3. Rethinking Productivity with GenAI: A Neurodivergent Students’ Perspective
    Hira Jamshed, Mustafa Naseem, Venkatesh Potluri, and Robin N. Brewer
    In Proceedings of the 27th International ACM SIGACCESS Conference on Computers and Accessibility, , 2025

2023

  1. Notably Inaccessible – Data Driven Understanding of Data Science Notebook (In)Accessibility
    Venkatesh Potluri*, Sudheesh Singanamalla*, Firn Tieanklin, and Jennifer Mankoff
    In Proceedings of the 25th International ACM SIGACCESS Conference on Computers and Accessibility, New York, NY, USA, 2023
    * Potluri and Singanamalla contributed equally to this work.

2022

  1. CodeWalk: Facilitating Shared Awareness in Mixed-Ability Collaborative Software Development
    Venkatesh Potluri*, Maulishree Pandey*, Andrew Begel, Michael Barnett, and Scott Reitherman
    In Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility, Athens, Greece, 2022
    * Potluri and Pandey contributed equally to this work.
  2. PSST: Enabling Blind or Visually Impaired Developers to Author Sonifications of Streaming Sensor Data
    Venkatesh Potluri, John Thompson, James Devine, Bongshin Lee, Nora Morsi, and 3 more authors
    In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology, Bend, OR, USA, 2022