Here comes trouble! Distinguishing GUI Component States for Blind and Low Vision Users using Large Language Models

# Data Code Repository

This repository contains open-source data code that provides utilities for the paper named “Here comes trouble! Distinguishing GUI Component States for Blind and Low Vision Users using Large Language Models”. The code is designed to facilitate data-related tasks and promote reproducibility in research and data analysis projects.

## Features

- Attribute identification and extraction: Including real-time recognition and extraction of GUI components in the view type, resource-id, color, action of four attributes

- Components State Distinction: Provides the prompt needed for large language models, covering their specific design schemes and chain of thought reasoning processes as well as contextual learning content.

- Implementation: Offers specific methods to realize the process, including the setting of relevant parameters and the use of functions.

## Installation

To use the data code, you can down or clone the required code.

Notably, before using the code, make sure the necessary environment configuration is done.

## Dependencies

The data code has the following dependencies:

Python (version 3.6 or higher)

NumPy

Pandas

Seaborn

Scikit-learn

Openai

Android Studio (version 4.0)

Install the required dependencies using pip:

pip install numpy..

##License

This data code is distributed under the MIT License. See LICENSE for more information.

##Copyright

All copyright of the tool is owned by the author of the paper.