# Demystifying Issues, Challenges, and Solutions for Multilingual Software Development (Artifact)

This is the artifact of the paper *Demystifying Issues, Challenges, and Solutions for Multilingual Software Development* to appear in ICSE 2023.


## 1. Getting started
### Environment preparation
1. Python version: 3.6 or upper version
2. Dependent libraries: scrapy, nltk, pandas, gensim.

Utilize pip install [lib_name] to install the libraries.

---
## 2. Directory structure
```
念岸 README.md                                        <- readme file
岫
念岸ICS.zip
念  念岸 Code                                          <- Code for all tool
岫  岫  念岸 step1 Scrapy tool                          <- Using for crawling posts
岫  岫  岫
岫  岫  念岸 step2 LDA topic model                      <- Using for getting development-
岫  岫  岫                                                issue-relevant topic words
岫  岫  岫
岫  岫  念岸 step3 Random sampling for Codebook         <- Using for randomly getting 
岫  岫  岫                                                codebook posts
岫  岫  岫                                     
岫  岫  念岸 step4 Random sampling for Coding Process   <- Using for randomly getting 
岫  岫  岫                                                coding process posts
岫  岫  岫
岫  岫  弩岸 Other analysis scripts                     <- Archived some analysis scripts 
岫  岫                                                   that may not be used in paper 
岫  岫
岫  弩岸 Data                                          <- Main dataset
岫     念岸 CodeBook.xlsx                              <- Using for the categorization
岫     岫
岫     念岸 dataset_10,444posts.csv                    <- Filtering via tags and #vote 
岫     岫                                   
岫     念岸 dataset_5,565posts.csv                     <- Filtering via topic modeling (LDA) 
岫     岫
岫     念岸 dataset_1,113posts.csv                     <- Random sampling for coding process
岫     岫   
岫     弩岸 dataset_586posts.csv                       <- Filtering via coding process
岫        
岫 
弩岸 LICENSE.txt                                      <- license file)

```
---
##3.Command line
In setp1 Scrapy tool, we use: *scrapy crawl -o output.csv getQA* start to crawl data from StackOverflow.

###Other recommended command parameters in Scrapy
scrapy bench -- Run quick benchmark test

scrapy check -- Check spider contracts

scrapy crawl -- Run a spider

scrapy edit -- Edit spider

scrapy fetch -- Fetch a URL using the Scrapy downloader

scrapy genspider -- Generate new spider using pre-defined templates

scrapy list -- List available spiders

scrapy parse -- Parse URL (using its spider) and print the results

scrapy runspider -- Run a self-contained spider (without creating a project)