Information System for Software Development Process Analysis Using DORA and SPACE Metrics
PDF (Russian)

Keywords

software development diagnostics
DORA metrics
SPACE framework
Goodhart’s law
Git repository data analysis
version management system
role-based access control
paired metric visualization
data privacy
bus factor
REST API

How to Cite

1.
Yatsuk S.N., Elovoi S.G. Information System for Software Development Process Analysis Using DORA and SPACE Metrics // Russian Journal of Cybernetics. 2026. Vol. 7, № 3. P. 50-55.

Abstract

we developed an information system for automated diagnostics of software development processes based on version-control data. We analyzed limitations of existing engineering analytics tools, which often focus on managerial monitoring of individual performance and may create incentives to optimize measured indicators rather than underlying processes, consistent with Goodhart’s law. We designed an architecture in which privacy protection and resistance to such metric-driven behavior are treated as requirements of the application programming interface rather than as user-interface features. Role-based access to data is enforced at the REST API level according to the defense-in-depth principle, with unauthorized requests rejected at the service layer rather than hidden only in the user interface. The methodological framework combines the five-metric DORA model with the SPACE framework for multidimensional assessment. We defined algorithms for computing lead time for changes, deployment frequency, change failure rate, decomposed merge-request cycle time, merge-request size distribution, and the Bus Factor for code modules from incrementally collected GitLab data. We implemented a minimum viable product with three role-based dashboards, paired visualization of speed and quality metrics, transparent calculation algorithms, report export, and Docker Compose deployment suitable for data-localization requirements. The system can be used to diagnose software development processes in teams working with GitLab.

Acknowledgements

this study is a part of the government contract No. FNEF-2024-0001 Development and Implementation of Trusted AI Systems Using New Mathematical and Algorithmic Methods; Fast Computing Models on Domestic Hardware awarded to the Kurchatov Institute (1023032100070-3-1.2.1)
PDF (Russian)

References

Forsgren N., Kersten M. DevOps Metrics. Communications of the ACM. 2018;61(4):44–48. DOI: 10.1145/3159169.

Forsgren N., Storey M.-A., Maddila C., Zimmermann T., Houck B., Butler J. The SPACE of Developer Productivity: There’s More to It than You Think. ACM Queue. 2021;19(1):20–48. DOI: 10.1145/3454122.3454124.

Strathern M. ’Improving Ratings’: Audit in the British University System. European Review. 1997;5(3):305–321.

Яцук С. Н., Еловой С. Г. Аналитическая платформа для оценки эффективности разработки GITALPHA. Труды НИИСИ РАН. 2026;16(1):49–52.

Bacchelli A., Bird C. Expectations, Outcomes, and Challenges of Modern Code Review. Proc. 35th Int. Conf. on Software Engineering (ICSE). 2013:712–721. DOI: 10.1109/ICSE.2013.6606617.

McIntosh S., Kamei Y., Adams B., Hassan A. E. An Empirical Study of the Impact of Modern Code Review Practices on Software Quality. Empirical Software Engineering. 2016;21(5):2146–2189.

Gousios G., Pinzger M., van Deursen A. An Exploratory Study of the Pull-Based Software Development Model. Proc. 36th Int. Conf. on Software Engineering (ICSE 2014). 2014:345–355.

Beller M., Bacchelli A., Zaidman A., Juergens E. Modern Code Reviews in Open-Source Projects: Which Problems Do They Fix? Proc. 11th Working Conf. on Mining Software Repositories (MSR). 2014:202–211.

Avelino G., Passos L., Hora A., Valente M. T. A Novel Approach for Estimating Truck Factors. Proc. 24th IEEE Int. Conf. on Program Comprehension (ICPC). 2016:1–10.

Jabrayilzade E., Evtikhiev M., Tu¨zu¨n E., Kovalenko V. Bus Factor in Practice. Proc. 44th Int. Conf. on Software Engineering: Software Engineering in Practice (ICSE-SEIP). 2022:97–106.

Rigby P. C., Bird C. Convergent Contemporary Software Peer Review Practices. Proc. 2013 9th Joint Meeting on Foundations of Software Engineering (ESEC/FSE). 2013:202–212.

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Downloads

Download data is not yet available.