Understanding Performance Concerns in the API Documentation of Data Science Libraries
- Resource Type
- Conference
- Authors
- Tao, Yida; Jiang, Jiefang; Liu, Yepang; Xu, Zhiwu; Qin, Shengchao
- Source
- 2020 35th IEEE/ACM International Conference on Automated Software Engineering (ASE) ASE Automated Software Engineering (ASE), 2020 35th IEEE/ACM International Conference on. :895-906 Sep, 2020
- Subject
- Computing and Processing
Documentation
Data science
Maintenance engineering
Search problems
Libraries
Software engineering
Software development management
API documentation
performance
data science
empirical study
- Language
- ISSN
- 2643-1572
The development of efficient data science applications is often impeded by unbearably long execution time and rapid RAM exhaustion. Since API documentation is the primary information source for troubleshooting, we investigate how performance concerns are documented in popular data science libraries. Our quantitative results reveal the prevalence of data science APIs that are documented in performance-related context and the infrequent maintenance activities on such documentation. Our qualitative analyses further reveal that crowd documentation like Stack Overflow and GitHub are highly complementary to official documentation in terms of the API coverage, the knowledge distribution, as well as the specific information conveyed through performance-related content. Data science practitioners could benefit from our findings by learning a more targeted search strategy for resolving performance issues. Researchers can be more assured of the advantages of integrating both the official and the crowd documentation to achieve a holistic view on the performance concerns in data science development.