Designing a combined model for evaluating and ranking the educational performance of higher education institutions

Document Type : research article

Authors

1 PhD Student in Industrial Management, Faculty of Management and Accounting, Allameh Tabataba'i University, Tehran, Iran

2 Professor, Department of Industrial Management, Faculty of Management and Accounting, Allameh Tabataba'i University, Tehran, Iran

3 Professor, Department of Industrial Management, Faculty of Management and Accounting, Allameh Tabataba'i University, Tehran,

4 assistant Professor, Department of Industry, Faculty of Engineering, Zanjan University, Zanjan, Iran

Abstract

The purpose of this research is to design an integrated model using a balanced scorecard and fuzzy inference system to evaluate the educational performance and ranking of these institutions with a comprehensive view and high accuracy. The research method is a case study. The statistical population includes 66 university experts in Semnan. Based on Cochran's formula and sample volume formula, 57 people were selected as the statistical sample in factor analysis. Two researcher-made questionnaires were used to identify the indicators and determine the scenery structures of the balanced scorecard. Content validity of the questionnaires was calculated based on the CVR validity index in all items more than 0.29 (for 40 experts and more) . The perspective of the balanced scorecard was examined. The AVE index in financial terms is 0.79, customer 0.89, growth and learning 0.83, internal processes 0.80, which indicates the validity of the appropriate structure. The reliability of the questionnaires was confirmed with Cronbach's alpha values ​​of 0.77 and 0.83, respectively. According to the results of "Roshddanesh" institute or score (0.71), "Koomesh" institute with score (0.62) and "Fazilat" institute with score (0.45) had the best educational performance, respectively. Findings of this study can, in addition to improving the accuracy of calculating the score of educational performance, determine the rank of educational performance of higher education institutions by considering the amount of resources used to achieve it.

Keywords


  • Ahmadi,   H. E.,   Royaee, S. J., Tayyebi, S., &   Boozarjomehry, R. B. (2020). A new insight into implementing Mamdani fuzzy inference system for dynamic process modeling: Application on flash separator fuzzy dynamic modeling. Engineering Applications of Artificial Intelligence, 9(2), 10-34.‏ [In Persian]
  • Al Jardali,  ,   Abdallah, F., &   Barbar, K.   (2015). measuring intentions among employees toward the use of a balanced scorecard and information system: A conceptual approach using the theory of planned behavior and the technology acceptance model. Procedia Economics and Finance, 26, 1146-1151.‏ [In Persian]
  • Ali Ahmadi, Jafari Eskandari, M. Khaleqi, GH. (2014). Determining the causal relations of science and technology development indicators of universities based on interpretive structural modeling and gray cognitive mapping with a balanced scorecard approach (Case study: Iran University of Science and Technology),Journal of Quantitative studies in management,5(2).52-73. [In Persian]
  • Alipoor, A. & Enayati, T. (2017). Strategic Management Studies of National Defence Studies. Strategic Management Studies of National Defence Studies, 26(26), 53-76. [In Persian]
  • Alsyouf, I. (2006).Methodology and Theory Measuring maintenance performance using a balanced scorecard approach, Journal of Quality in Maintenance Engineering, 12 (2),133-149. [In Persian]
  • Asadi,e.Zakeri,M.Zeriati,M(2014).Performance evaluation model of Shahid Sattari University of Aeronautical Sciences and Technology based on balanced scorecard technique,Journal of Scientific Quarterly of Human Resources Studies,4(14),151-177. [In Persian]
  • Azizi, F., Behzadian, M., & Afshari, A. J. (2012). Which perspectives in the balanced scorecard are appropriate for the universitie?European Journal of Scientific Research, 74(2), 164-175.‏ [In Persian]
  • Ballou, B. Casey, R.J. Grenier, J.H. and Heitger, D.L. (2011). Exploring the strategic integration of sustainability initiatives: opportunities for accounting research, Journal of Accounting Research 2 (26), 1-43.
  • Chen S& Yang, C. & Shiau ,J.(2006).Scorecard in the Performance Evaluation of Higher Education, TheTQM Magazine, 18(2),: 190-205.
  • Daromes, F. E., & Ng, S. (2015). Embedding core value into the internal quality assurance systems in higher education. Procedia-Social and Behavioral Sciences, 211, 660-664.
  • Delker, S. G. B. (2003). Balanced scorecard: An instrument of change for facilities services. A project presented to the faculty of California State University, San Bernardino.
  • Dorweiler, V. P., & Yakhou, M. (2005). Scorecard for academic administration performance on the campus. Managerial Auditing Journal, 20 (2), 138-144.
  • Foong, K. C., Chee, C. T., & Wei, L. S. (2009). Adaptive network fuzzy inference system (ANFIS) handoff algorithm. In 2009 International Conference on Future Computer and Communication (pp. 195-198). IEEE.
  • Ghorchiyan,N.Shahrakipor,H.(2010).Investigating performance appraisal systems in the world in order to provide a suitable model for higher education, Journsl of Management Research,85:1-19.‏ [In Persian]
  • Heydari, M.Gorbani Dolatabadi, M. (2016). Evaluate the performance of universities using the balanced scorecard model, the first international conference on new paradigms of business and organizational intelligence management. [In Persian]
  • Kanji, G. K., Malek, A., & Tambi, B. A. (1999). Total quality management in UK higher education institutions. Total Quality Management, 10(1), 129-153.
  • Kaplan, R. S., & Norton, D. P. (2001). The strategy-focused organization: How balanced scorecard companies thrive in the new business environment. Harvard Business Press.
  • Keegan, D. P., Eiler, R. G., & Jones, C. R. (1989). Are your performance measures obsolete? Strategic Finance, 70(12), 45.
  • Lamotte, G., & Carter, G. (2000). Are the Balanced Scorecard and the EFQM Excellence Model mutually exclusive or do they work together to bring added value to a company. EFQM Common Interest Days.
  • Mamdani, E. H., & Assilian, S. (1975). An experiment in linguistic synthesis with a fuzzy logic controller. International journal of man-machine studies, 7(1), 1-13.
  • Mehr Al-hassani, M.Emami, M.Haghdoost, A.Amanpor.S (2013). Performance evaluation of medical universities in the country with a combined approach of balanced scorecard and hierarchical analysis process (AHP-BSC): 2013. Journal of Epidemiology of Iran (12)5, 55-64. [In Persian]
  • Mehregan, M.Dehghan nayeri, M. (2008).Approach for evaluating top management universities in Tehran province, Journal of Industrial Management (1)2,153-168. [In Persian]
  • Mozon, e.Shoar, M.Salehi sadaghiyani, j. (2014).Presenting a Performance Evaluation Model Based on Balanced Scorecard (BSC) Approach for Private Banks Listed on Tehran Stock Exchange, journal of Quantitative studies in management, 5(3), 37-56.
  • Papenhausen, C., & Einstein, W. (2006). Implementing the Balanced Scorecard at a college of business. Measuring Business Excellence.
  • Pietrzak, M., Paliszkiewicz, J., & Klepacki, B. (2015). The application of the balanced scorecard (BSC) in the higher education setting of a Polish university. Online Journal of Applied Knowledge Management, 3(1), 151-164.
  • Riviezzo, A., Santos, S. C., Liñán, F., Napolitano, M. R., & Fusco, F. (2019). European universities seeking entrepreneurial paths: the moderating effect of contextual variables on the entrepreneurial orientation-performance relationship. Technological Forecasting and Social Change, 141, 232-248.
  • Saeed Ardakani, S. Mansouri, H. Nejati Aji Bishe, M. (2008). Provide a model to evaluate the performance of the research supply chain in universities and higher education institutions of the country using the balanced scorecard method, Journal of Higher Education Letter, 1(3), 105-123. [In Persian]
  • Shoghli, A.Roshenas.KH. (2016).Application of balanced scorecard and hierarchical analysis in the performance of scientific groups, Journal of Education Development in Medical Sciences, 9(22), 53-63.
  • Sim, K. L., & Koh, H. C. (2001). Balanced scorecard: a rising trend in strategic performance measurement. Measuring business excellence.
  • Sorki, M.Aghili, R.Ranjbar.Y. (2018). Balanced scorecard in determining indicators for measuring the performance of higher education, Quarterly Journal of General Policy in Management 9(32),1-14 . [In Persian]
  • Valmohamadi, C.H, Firozrh, N.)2009).Evaluate the performance of the organization with a balanced scorecard, Journal of Management Quarterly7 (18), 72-87. [In Persian]
  • Weerasooriya, R. (2016). Universities Strategic Evaluation Using the Balanced Scorecard (BSC)–Focus on Internal Business Process Perspective (IBPP). International Journal of Business, Economics and Law, 2(1).
  • Yarmohamadiyan,M.Sahtalebi,S.Foladvand,M.(2015).Provide a model for evaluating the performance of universities; Case study of Islamic Azad University, Khorasgan Branch,Journal of New Approach in Educational Management,2(22),19-37. [In Persian]
  • Yazdan Panah, A. Ehsani,A(2009).Model of Performance Evaluation Indicators in Higher Education Centers in the Strategic Planning Process Case: Shahid Beheshti University,Journal of Human Resource Management Research,2(1),129-154. [In Persian]

Yudatama, U., & Sarno, R. (2016). Priority determination for higher education strategic planning using balanced scorecard, FAHP and TOPSIS (Case study: XYZ University). In IOP Conference Series: Materials Science and Engineering, 105(1). IOP Publishing