Quality assessment for large-scale industrial software systems: experience report at Alibaba

Chen Zhi, Shuiguang Deng, Jianwei Yin, Min Fu, Hai Zhu, Yuanping Li, Tao Xie

Research output: Chapter in Book/Report/Conference proceedingConference proceeding contributionpeer-review

5 Citations (Scopus)


To assure high software quality for large-scale industrial software systems, traditional approaches of software quality assurance, such as software testing and performance engineering, have been widely used within Alibaba, the world's largest retailer, and one of the largest Internet companies in the world. However, there still exists a high demand for software quality assessment to achieve high sustainability of business growth and engineering culture in Alibaba. To address this issue, we develop an industrial solution for software quality assessment by following the GQM paradigm in an industrial setting. Moreover, we integrate multiple assessment methods into our solution, ranging from metric selection to rating aggregation. Our solution has been implemented, deployed, and adopted at Alibaba: (1) used by Alibaba's Business Platform Unit to continually monitor the quality for 60+ core software systems; (2) used by Alibaba's R&D Efficiency Unit to support group-wide quality-aware code search and automatic code inspection. This paper presents our proposed industrial solution, including its techniques and industrial adoption, along with the lessons learned during the development and deployment of our solution.

Original languageEnglish
Title of host publicationProceedings - 2019 26th Asia-Pacific Software Engineering Conference, APSEC 2019
Place of PublicationLos Alamitos, CA
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Number of pages8
ISBN (Electronic)9781728146485
Publication statusPublished - 2019
Event26th Asia-Pacific Software Engineering Conference, APSEC 2019 - Putrajaya, Malaysia
Duration: 2 Dec 20195 Dec 2019

Publication series

NameAsia-Pacific Software Engineering Conference
ISSN (Print)1530-1362


Conference26th Asia-Pacific Software Engineering Conference, APSEC 2019


  • experience report
  • software quality assessment
  • software quality model


Dive into the research topics of 'Quality assessment for large-scale industrial software systems: experience report at Alibaba'. Together they form a unique fingerprint.

Cite this