A Cross Validation of OSS Reliability Assessment Based on Deep Multimodal and Multitask Learning

Authors

  • Shan Jiang Yamaguchi University, Japan
  • Yoshinobu Tamura Yamaguchi University, Japan
  • Shigeru Yamada Tottori University, Japan

DOI:

https://doi.org/10.13052/jgeu0975-1416.1413

Keywords:

Software reliability, deep learning, open source software, deep multimodal and multitask learning

Abstract

In recent years, open source software (OSS) has become ubiquitous in every field of our daily life. Hence, the OSS’s reliability is a significant challenge. The traditional models, like the software reliability growth model, can not handle a large scale of data efficiently, while the deep learning provides an effective method. This paper proposes a multi-input multi-output deep neural network to predict the fault detection time intervals and the fault modification time intervals simultaneously. Additionally, we present several numerical examples with a cross validation conducted with 3 types of data splits.

Downloads

Download data is not yet available.

Author Biographies

Shan Jiang, Yamaguchi University, Japan

Shan Jiang is currently a senior student at Yamaguchi University in Japan. His research interests the reliability assessment method of OSS at Yamaguchi University, Ube, Japan.

Yoshinobu Tamura, Yamaguchi University, Japan

Yoshinobu Tamura received the B.S.E., M.S., and Ph.D. degrees from Tottori University in 1998, 2000, and 2003, respectively. From 2003 to 2006, he was a Research Assistant at Tottori University of Environmental Studies. From 2006 to 2009, he was a Lecturer and Associate Professor at Faculty of Applied Information Science of Hiroshima Institute of Technology, Hiroshima, Japan. From 2009 to 2017, he was an Associate Professor at the Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Ube, Japan. From 2017 to 2019, he has been working as a Professor at the Faculty of Knowledge Engineering, Tokyo City University, Tokyo, Japan. Since 2020, he has been working as a Professor at the Faculty of Information Technology, Tokyo City University, Tokyo, Japan. Since 2021, he has been working as a Professor at the Graduate School of Sciences and Technology for Innovation, Yamaguchi University, Ube, Japan. His research interests include reliability assessment for open source software, big data, clouds, reliability. He is a regular member of the Institute of Electronics, the Information and Communication Engineers of Japan, the Operations Research Society of Japan, the Society of Project Management of Japan, the Reliability Engineering Association of Japan, and the IEEE. He has authored the book entitled as OSS Reliability Measurement and Assessment (Springer International Publishing, 2016). Dr. Tamura received the Presentation Award of the Seventh International Conference on Industrial Management in 2004, the IEEE Reliability Society Japan Chapter Awards in 2007, the Research Leadership Award in Area of Reliability from the ICRITO in 2010, the Best Paper Award of the IEEE International Conference on Industrial Engineering and Engineering Management in 2012, the Honorary Professor from Amity University of India in 2017, the Best Paper Award of the 24th ISSAT International Conference on Reliability and Quality in Design in 2018, the Outstanding Paper Award of the IEEE International Conference on Industrial Engineering and Engineering Management in 2022, and the Amity Global Academic Excellence Award of the IEEE 4th International Conference on Intelligent, Engineering & Management in 2023.

Shigeru Yamada, Tottori University, Japan

Shigeru Yamada was born in Hiroshima Prefecture, Japan, on July 6, 1952. He received the B.S.E., M.S., and Ph.D. degrees from Hiroshima University, Japan, in 1975, 1977, and 1985, respectively. From 1993/10 to 2018/3, he had been working as a professor at the Department of Social Management Engineering, Graduate School of Engineering, Tottori University, Tottori-shi, Japan. He is an Emeritus Professor of Tottori University. He has been also a Honorary Professor at Amity University, India, since 2015. His research interests include software reliability engineering, quality management engineering, and project management. He has published over 600 reviewed technical papers in the area of software reliability engineering, project management, reliability engineering, and quality control. He has authored several books entitled such as Introduction to Software Management Model (Kyoritsu Shuppan,1993), Software Reliability Models: Fundamentals and Applications (JUSE, Tokyo, 1994), Statistical Quality Control for TQM (Corona Publishing, Tokyo, 1998), Software Reliability: Model, Tool, Management (The Society of Project Management, 2004), Quality-Oriented Software Management (Morikita Shuppan, 2007), Elements of Software Reliability-Modeling Approach-(Kyoritsu Shuppan, 2011), Project Management (Kyoritsu Shuppan, 2012), Software Engineering-Fundamentals and Applications-(Science, Tokyo, 2013), Software Reliability Modeling: Fundamentals and Applications (Springer-Verlag, Tokyo/Heidelberg, 2014), and OSS Reliability Measurement and Assessment (Springer International Publishing, Switzerland, 2016). Dr. Yamada received the Best Author Award from the Information Processing Society of Japan in 1992, the TELECOM System Technology Award from the Telecommunications Advancement Foundation in 1993, the Best Paper Award from the Reliability Engineering Association of Japan in 1999, the International Leadership Award in Reliability Engg. Research from the ICQRIT/SREQOM in 2003, the Best Paper Award at the 2004 International Computer Symposium, the Best Paper Award from the Society of Project Management in 2006, the Leadership Award from the ISSAT (International Society of Science and Applied Technologies, U.S.A.) in 2007, the Outstanding Paper Award at the IEEE International Conference on Industrial Engineering and Engineering Management (IEEM2008) in 2008, the International Leadership and Pioneering Research Award in Software Reliability Engineering from the SREQOM/ICQRIT in 2009, the Exceptional International Leadership and Contribution Award in Software Reliability at the ICRITO’2010, the 2011 Best Paper Award from the IEEE Reliability Society Japan Chapter in 2012, the Leadership Award from the ISSAT in 2014, the Project Management Service Award from the Society of Project Management, “Honorary Canon” Appointment from the Korean Reliability Society in 2014, Title of “Honorary Professor” Recognition from Amity University, India, in 2015, Contribution Award for Promoting OR from the Operations Research Society of Japan in 2017, Research Award for Outstanding Contributions in Software Reliability Engineering from the ISSAT in 2017, Best Paper Award at the ISSAT International Conference on Reliability and Quality in Design in 2018, Society Award from the Society of Project Management in 2020, IEEE Reliability Society Japan Joint Chapter 2020 Reliability Engineering Award in 2021, and Lifetime Achievement Award from the ISSAT in 2025. He is a life member of the IEICE, a life member of the Information Processing Society of Japan, member of the Operations Research Society of Japan (Fellow Member), the Japanese Society for Quality Control, and the Society of Project Management, and the IEEE Life Member. He is also an Honorary Canon of the Korean Reliability Society.

References

Y. Tamura and S. Yamada, Applied OSS Reliability Assessment Modeling, AI and Tools: Mathematics and AI for OSS Reliability Assessment, First edition. Cham, Switzerland: Springer, 2024. doi: nolinkurl10.1007/978-3-031-64803-8.

S. Yamada and Y. Tamura, OSS Reliability Measurement and Assessment. 1st ed. 2016. Cham: Springer International Publishing, 2016. doi: nolinkurl10.1007/978-3-319-31818-9.

S. Miyamoto, Y. Tamura, and S. Yamada, “A method of reliability assessment based on trend analysis for open source software,” International Journal of Reliability, Quality & Safety Engineering, vol. 31, no. 4, pp. 1–15, 2024, doi: nolinkurl10.1142/S0218539324500049.

S. Miyamoto, Y. Tamura, and S. Yamada, “Reliability assessment tool based on deep learning and data preprocessing for OSS,” American Journal of Operations Research, vol. 12, pp. 111–125, 2022, doi: nolinkurl10.4236/ajor.2022.123007.

P. Mell and T. Grance, “The NIST definition of cloud computing,” NIST Special Publication, vol. 800-145, Gaithersburg, MD: National Institute of Standards and Technology, 2011.

T. Atmaca, T. Begin, A. Brandwajn, and H. Castel-Taleb, “Performance evaluation of cloud computing centers with general arrivals and service,” IEEE Transactions on Parallel and Distributed Systems, vol. 27, no. 8, pp. 2341–2348, 2016, doi: nolinkurl10.1109/TPDS.2015.2499749.

N. J. Yeager and R. E. McGrath, Web Server Technology. San Francisco, CA, USA: Morgan Kaufmann, 1996.

Y. S. Kim, K. Y. Song, H. Pham, and I. H. Chang, “A software reliability model with dependent failure and optimal release time,” Symmetry, vol. 14, no. 2, p. 343, 2022, doi: nolinkurl10.3390/sym14020343.

I. Goodfellow, Y. Bengio, and A. Courville, Deep Learning. London, England: MIT Press, 2016.

Y. LeCun, Y. Bengio, and G. Hinton, “Deep learning,” Nature, vol. 521, no. 7553, pp. 436–444, 2015, doi: nolinkurl10.1038/nature14539.

P. Covington, J. Adams, and E. Sargin, “Deep neural networks for YouTube recommendations,” in Proc. 10th ACM Conf. Recommender Systems, New York, NY, USA, 2016, pp. 191–198, doi: nolinkurl10.1145/2959100.2959190.

G. Hinton et al., “Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups,” IEEE Signal Processing Magazine, vol. 29, no. 6, pp. 82–97, 2012, doi: nolinkurl10.1109/MSP.2012.2205597.

Q. Li, L. Li, Y. Shao, R. Wang, and H. Hao, “A multi-task machine learning approach for data efficient prediction of blast loading,” Engineering Structures, vol. 326, Art. no. 119577, 2025, doi: nolinkurl10.1016/j.engstruct.2024.119577.

T. Marquet et al., “A Comparison of Multi-task Learning and Single-Task Learning Approaches,” Applied Cryptography and Network Security Workshops, vol. 13907, Switzerland: Springer, 2023, pp. 121–138. doi: nolinkurl10.1007/978-3-031-41181-6_7.

The OpenStack Project, OpenStack. [Online]. Available: https://www.openstack.org/.

The Apache Software Foundation, The Apache HTTP Server Project. [Online]. Available: https://www.apache.org/.

J. Wang and C. Zhang, “An Open-Source Software Reliability Model Considering Learning Factors and Stochastically Introduced Faults,” Applied Sciences, vol. 14, no. 2, p. 708, 2024, doi: nolinkurl10.3390/app14020708.

F. Zhuang et al., “A Comprehensive Survey on Transfer Learning,” Proceedings of the IEEE, vol. 109, no. 1, pp. 43–76, 2021, doi: nolinkurl10.1109/JPROC.2020.3004555.

S. Tang, S. Huang, C. Zheng, E. Liu, C. Zong, and Y. Ding, “A novel cross-project software defect prediction algorithm based on transfer learning,” Tsinghua science and technology, vol. 27, no. 1, pp. 41–57, 2022, doi: nolinkurl10.26599/TST.2020.9010040.

O. P. Omondiagbe, S. A. Licorish, and S. G. MacDonell, “Improving transfer learning for software cross-project defect prediction,” Applied intelligence (Dordrecht, Netherlands), vol. 54, no. 7, pp. 5593–5616, 2024, doi: nolinkurl10.1007/s10489-024-05459-1.

Downloads

Published

2025-10-24

How to Cite

Jiang, S., Tamura, Y., & Yamada, S. (2025). A Cross Validation of OSS Reliability Assessment Based on Deep Multimodal and Multitask Learning. Journal of Graphic Era University, 14(01), 53–78. https://doi.org/10.13052/jgeu0975-1416.1413

Issue

2026: Vol 14 Iss 1

Section

Articles