Pooja Batra*, Aman Jatain

Department of Computer Science, Amity University, Haryana, India


Download Citation: |
Download PDF


Today most of the organizations are switching to DevOps for faster and reliable delivery. It promotes the collaboration between developers and IT teams. In ancient development practices, development and operation teams were working in silos and when DevOps introduced, it combines both teams to integrate and automate the processes. A single team with cross functioning members provides not only technical advantages but also cultural benefits. Faster delivery of software, less complex designs, stable operating environments, customer satisfaction is some of the outcomes of DevOps. Although it proved to be a responsive environment for software delivery yet lacks in quantifiable perspective. There is no metric defined to measure performance and that can be estimated by using key attributes of software. In this research hybrid framework is proposed to improve the software reliability and productivity. Proposed framework for DevOps is named TDMBD (Test Driven Measurement Based DevOps) which provides solutions to challenges in DevOps like performance issues, poorly defined methodologies, and unstandardized processes. Paper focuses on defining and measuring metrics that are derived from measurement-based system of software and TDMBD is evaluated based on metrics analysis. To validate results of proposed approach a comparison is shown in between existing approach and proposed approach. Finally, through proposed method better quality of product is retrieved.

Keywords: DevOps, Development and operations, Agile, CI/CD, Software development, Framework.

Share this article with your colleagues



  1. Astel, D. 2003. Test driven development: A practical guide (A. D. Library (ed.)). Prentice Hall Professional Technical Reference.

  2. Batra, P., Jatain, A. 2020a. DevOps: Current practices, challenges and implications. International Journal of Advanced Sciences and Technology, 29, 11991–12001. http://sersc.org/journals/index.php/IJAST/article/view/27879

  3. Batra, P., Jatain, A. 2020b. Measurement based performmace evaluation of DevOps. Lecture Series on Computational Performance Evaluation.

  4. Beck, K., Beedle, M., Bennekum, A. Van, Cockburn, A. 2001. Manifesto for agile software development. https://pdfs.semanticscholar.org/2dc5/d5a781ab55d3bba09d2fdb05ebf87bde7a2f.pdf

  5. Dissanayake, S. 2018. Measurable metrics for software process improvement. European Journal of Computer Science and Information Technology, 6, 33–43.

  6. Duvall, P. 2018. Measuring DevOps success with four key metrics. https://stelligent.com/2018/12/21/measuring-devops-success-with-four-key-metrics/

  7. Elberzhager, F., Arif, T., Naab, M., Süß, I., Koban, S. 2017. From agile development to devops: Going towards faster releases at high quality - Experiences from an industrial context. Lecture Notes in Business Information Processing, 269, 33–44. https://doi.org/10.1007/978-3-319-49421-0_3

  8. Erich, F., Amrit, C., Daneva, M. 2014. A mapping study on cooperation between information system development and operations. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 8892, 277–280. https://doi.org/10.1007/978-3-319-13835-0_21

  9. Floris, E., Amrit, C., Daneva, M. 2014. DevOps litterature review. Product-Focused Software Process Improvement, 8892. https://doi.org/10.1007/978-3-319-13835-0

  10. Futong, H., Tingting, S. 2013. Software project metrics and quality management. Proceedings - 2013 9th International Conference on Intelligent Information Hiding and Multimedia Signal Processing, IIH-MSP 2013. https://doi.org/10.1109/IIH-MSP.2013.158

  11. Gottesheim, W. 2015. Challenges, benefits and best practices of performance focused DevOps. LT 2015 - Proceedings of the 4th ACM/SPEC International Workshop on Large-Scale Testing, in Conjunction with ICPE 2015, 3. https://doi.org/10.1145/2693182.2693187

  12. Huttermann, M. 2012. Beginning DevOps fpr devlopers. In DevOps for Developers (2012th ed., 4–13). Apress.

  13. Hüttermann, M. 2012. Introducing DevOps. In DevOps for Developers, 15–32. https://doi.org/10.1007/978-1-4302-4570-4_2

  14. Khan, S.H. 2002. Software quality metrics overview. Metrics and Models in Software Quality Engineering. Boston,2nd edition, Addison-Wesley.

  15. Kumar, C., Yadav, D.K. 2013. Software quality modeling using metrics of early artifacts. IET Conference Publications. https://doi.org/10.1049/cp.2013.2285

  16. Liu, Y., Zhou, Y. 2017. The challenges and mitigation strategies of using DevOps during software development. Blekinge Institute of Technology.

  17. Madeyski, L., Szała, Ł. 2007. The impact of test-driven development on software development productivity - An empirical study. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). https://doi.org/10.1007/978-3-540-75381-0_18

  18. Mäkinen, S., Münch, J. 2014. Effects of test-driven development: A comparative analysis of empirical studies. Lecture Notes in Business Information Processing. https://doi.org/10.1007/978-3-319-03602-1_10

  19. Musa, J.D., Okumoto, K. 1984. A logarithmic poisson execution time model for software reliability measurement. In Citeseer. http://citeseerx.ist.psu.edu/viewdoc/download?doi=

  20. Nagarajan, A.D., Overbeek, S.J. 2018. A DevOps implementation framework for large agile-based financial organizations. Lecture Notes in Computer Science (Including Subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), 11229 LNCS, 172–188. https://doi.org/10.1007/978-3-030-02610-3_10

  21. Nicolau de França, B.B., Jeronimo, H., Travassos, G.H. 2016. Characterizing DevOps by hearing multiple voices. ACM International Conference Proceeding Series, 53–62. https://doi.org/10.1145/2973839.2973845

  22. Platz, W. 2020. Risk coverage: A new currency for testing. https://www.stickyminds.com/article/risk-coverage-new-currency-testing

  23. Rahmani, C., Khazanchi, D. 2010. A study on defect density of open source software. Proceedings - 9th IEEE/ACIS International Conference on Computer and Information Science, ICIS 2010. https://doi.org/10.1109/ICIS.2010.11

  24. Shahin, M., Ali Babar, M., Zhu, L. 2017. Continuous integration, delivery and deployment: A systematic review on approaches, tools, challenges and practices. IEEE Access, 5, 3909–3943. https://doi.org/10.1109/ACCESS.2017.2685629


Received: 2021-05-24
Revised: 2021-06-23
Accepted: 2021-07-05
Publication Date: 2021-09-01

Cite this article:

Batra, P., Jatain, A. 2021. Hybrid model for evaluation of quality aware DevOps. International Journal of Applied Science and Engineering, 18, 2021158. https://doi.org/10.6703/IJASE.202109_18(5).013

  Copyright The Author(s). This is an open access article distributed under the terms of the Creative Commons Attribution License (CC BY 4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are cited.