The application of DEA for the sake of assessing and evaluating the performance of researchers at research institutes: Case study of a research center

Document Type : Original Article

Authors

1 Department of computer science, Qom university of technology, Qom. Iran.

2 Industrial Engineering Department, Malek Ashtar University of Technology, Tehran, Iran.

3 Department of Industrial Engineering , Qom university of technology, Qom. Iran.

Abstract

The purpose of this study is to provide a structured method for evaluating the performance of researchers in research organizations using Data Envelopment Analysis (DEA) based on exact and objective indexes. To do so, after preparing a questionnaire through a literature review and interviews with experts, the data collected from the researchers of a research center was analyzed, and the input index and output indexes affecting the efficiency of researchers were interpreted according to DEA. Based on the proposed method, researchers receive inputs from research organizations and provide outputs to such centers, which are used to measure the performance and efficiency of researchers to protect such evaluations against human errors that might affect the evaluation results. The proposed method was applied to 56 researchers with four input indexes and 10 output indexes. The output index revealed that the score for the efficiency of 11 researchers was 1, and the rest of researchers' score was less than 1, where their performance was compared with the first 11 researchers. Comparing our method which is extracted from the study of literature with other methods revealed that our method is both extensive and intensive and it has homogeneity to cover the performance of researchers.

Keywords

Main Subjects

References

[1] M.E. Warner, C. Hinrichs, J. Schneyer, and L. Joyce, “From knowledge extended to knowledge created: Challenges for a new extension paradigm,” J. Ext., vol. 36, no. 4, 1998.
[2] A. Afkhami, A. Maleki, M. A. Zolfi Gol, and D. Nematzadeh, “A look at the COMSTECH report on introducing prominent researchers and engineers of Islamic conference member countries,” Rahyaft, vol. 19, no. 44, pp. 42-48, 2009 [In Persian].
[3] M. Mehregaan and M. Zaali, “In search of a model for evaluating the performance of research and development organizations,” Manag. Studi. Dev. Evol., vol. 10, no. 39-40, pp. 123-153, 2004, dor: 20.1001.1.22518037.1382.10.39.40.6.8 [In Persian].
[4] E.W. Said, The Selected Works of Edward Said 1996-2006, Vintage, ISBN 978-0525565314, 2019.
[5] S.M. Farhadi, M.M. Rashidi, and Gh.R. Asili, “Performance Management Model and its New Challenges on the Iranian R&D,” Quarterly J. Res. Plan. Hig. Educ., vol. 10, no. 4, pp. 151-174, 2004 [In Persian].
[6] A. Soltani, Developing Human Capital, Arkan-e Danesh, 2013 [In Persian].
[7] S. Sadraei and R. Behradi Yekta, “A Criticize on Booklet of Research and Technology Performance Evaluation of Universities and Research Institutes in 2005 & 2006,” Roshd-e-Fanavari, vol. 5, no. 17, pp. 1-10, 2009 [In Persian].
[8] R. Mahdi, “Development of Commercialization of the Scientific Achievements through Pilot Plant Research,” Roshd-e-Fanavari, vol. 6, no. 24, pp. 1-10, 2010 [In Persian].
[9] A. Negahban and F. Mostajabi, Research Methodology Guide Using Questionnaires, Tehran, Jahad Daneshgahi Publications, 2005 [In Persian].
[10] G. Chirici, “Assessing the scientific productivity of Italian forest researchers using the Web of Science, SCOPUS and SCIMAGO databases,” iForest-Biogeosci. Forestry, vol. 5, no. 3, p. 101, 2012.
[11] B. Lak, S. Bakhtiari, and S.M. Rezvani, “Selection of the optimal conversation algorithm in the Internet context based on simulation,” vol. 2, no. 4, pp. 25-39, 2021, doi: 10.22034/pitc.2021.208213.1053 [In Persian].
[12] M. Niaei, J. Tanha, G. Shahmohammadi, and A. Poorebrahimi, “A model for Multi-Class Intrusion Detection Using the Dragonfly Feature Selection by Learning on the KDD-CUP99 Dataset,” Electron. Cyber Def., vol. 10, no. 3, pp. 33-42, 2022, dor: 20.1001.1.23224347.1401.10.3.4.2 [In Persian].
[13] M. Meyer, R.W. Waldkirch, and M.A. Zaggl, “Relative performance measurement of researchers: The high impact of data source selection,” Schmalenbach Bus. Rev., vol. 13, no. 4, pp.308-330, 2012, doi: 10.1007/BF03396844.
[14] J. Altmann, A. Abbasi, and J. Hwang, "Evaluating the productivity of researchers and their communities: The RP-index and the CP-index," TEMEP Discussion Papers 201048, Seoul National University; Technology Management, Economics, and Policy Program (TEMEP), 2010.
[15] C.L. Ubeda and F.C.A. Santos, “Staff development and performance appraisal in a Brazilian research centre,” Eur. J. Innov. Manag., vol. 10, no. 1, pp. 109-125, 2007.
[16] H. Samavati and S.A. Nejat, “Investigating the performance evaluation system of NAJA employees from the perspective of managers,” Police Hum. Dev., vol. 6, no. 22, pp. 19-49, 2009. [In Persian]
[17] A. Pourhabib Yekta and M. Maghbouli, “Performance measurement in data envelopment analysis: a BCC-based approach,” J. Decis. Operat. Res., vol. 8, no. 3, pp. 800-813, 2023, doi: 10.22105/dmor.2023.350160.1631 [In Persian].
[18] A. Hosseinpoor, A. Ghorbanpour, and H. Shabandarzadeh, “Evaluating the Efficiency of Circular Economies in Persian Gulf Countries in Terms of Municipal Solid Waste Management,” Quarterly J. Quant. Econ., vol. 21, no. 1, pp. 87-106, 2024, doi: 10.22055/jqe.2023.42312.2523 [In Persian].
[19] F. Saghafi, M. Momeni, M. Tahari Mehrjerdi, and M. Baghaei, “Measuring the efficiency of technology units in strategic industries from the perspective of regional development (Case Study: Food Industries of Razavi Khorasan Province),” Manag. Improv., vol. 16, no. 4, pp. 1-22, 2022, doi: 10.22034/jmi.2022.345737.2789 [In Persian].
[20] N. Bagheri Mazraeh, M. Rostami Mal Khalife, and M. Varzi, “A comparison of super-efficiency through data envelopment analysis technique and financial ratios in Iranian stock exchange banks,” J. Decis. Operat. Res., vol. 6 (Special Issue), pp. 1-16, 2022, doi: 10.22105/dmor.2021.236731.1163 [In Persian]. 
[21] H. Azizi, “Supplier Performance Evaluation Using a Nonparametric Approach,” Mod. Res. Perform. Eval., vol. 1, no. 1, pp. 31-41, 2022, doi: 10.22105/mrpe.2022.140221 [In Persian].
[22] S. Mirsadeghpour Zoghi, M. Sanei, G. Tohidi, S. Banihashemi, and N. Modarresi, “Assets performance evaluation with the use of returns distribution characteristics,” J. Decis. Operat. Res., vol. 8, no. 3, pp. 771-784, 2023, doi: 10.22105/dmor.2022.332170.1587 [In Persian].
[23] S.H. Hajiagha, H. Amoozad Mahdiraji, S.S. Hashemi, J.A. Garza-Reyes, and R. Joshi, “Public hospitals performance measurement through a three-staged data envelopment analysis approach: Evidence from an emerging economy,” Cybernetics Syst., vol. 54, no. 1, pp. 1-26, 2023.
[24] I. Costa Melo et al., “A performance index for traditional retailers incorporating digital marketplace: Benchmarking through data envelopment analysis (DEA),” J. Org. Comput. Electron. Commer., pp. 1-21, 2023.
[25] C.C. Kang, C.M. Feng, P.F. Chou, W.M. Wey, and H.A. Khan, “Mixed network DEA models with shared resources for measuring and decomposing performance of public transportation systems,” Res. Transp. Bus. Mgmt., vol. 46, p. 100828, 2023.
[26] Y. Sun, D. Wang, F. Yang, and S. Ang, “Efficiency evaluation of higher education systems in China: A double frontier parallel DEA model,” Comput. Ind. Eng., vol. 176, p. 108979, 2023.
[27] T.C.C. Nepomuceno, A.P.C.S. Costa, and C. Daraio, “Theoretical and empirical advances in the assessment of productive efficiency since the introduction of DEA: A bibliometric analysis,” Int. J. Operat. Res., vol. 46, no. 4, pp. 505-549, 2023.
[28] B.T. Yen, M.J. Huang, H.J. Lai, H.H. Cho, and Y.L. Huang, “How smart port design influences port efficiency–a dea-tobit approach,” Res. Transp. Bus. Mgmt., vol. 46, p. 100862, Jan. 2023.
[29] M. Bashokouh and I. Ghasemi Hamedani, “Investigation the effect of knowledge management on the performance and loyalty of employees with the moderating role of innovation (case study: employees of Tabriz Petrochemical Company),” Strateg. Manag. Organ. Knowl., vol. 5, no. 4, pp. 75-109, 2022, doi: 10.47176/smok.2022.1481 [In Persian].
[30] M. Babaee Farsani, S. Fathollahi, and M. Moradi, “The Analysis of the Knowledge -Based Leadership Relationship, Knowledge Management Behavior and Innovation Performance (Case Study: Small and Medium Companies of Chaharmahal & Bakhtiari Province),” Strateg. Manag. Organ. Knowl., vol. 5, no. 1, pp. 135-163, 2022, doi: 10.47176/smok.2022.1394 [In Persian].
[31] H. Homaypour, A. Monvarian, and R. Gholipour, “Designing a Performance Evaluation Model for Mobile Telecommunication Company of Iran with a Knowledge-Based Organization Approach,” Strateg. Manag. Organ. Knowl., vol. 4, no. 1, pp. 155-195, 2021, doi: 10.47176/smok.2021.1258 [In Persian].
[32] S. Amiri, N. Nikkam, and M. Sahebinejad, “Statistical Survey of Nanotechnology related Patents as an Indicator of Nanotechnology Creation,” J. Sci. Technol. Policy, vol. 1, no. 3, pp. 1-13, 2008, dor: 20.1001.1.20080840.1387.1.3.2.2 [In Persian].
[33] A. Charnes, W.W. Cooper, and E. Rhodes, “Measuring the efficiency of decision making units,” Eur. J. Operat. Res., vol. 2, no. 6, pp. 429-444, Nov. 1978.
Soft Computing Journal
Volume 13, Issue 2 - Serial Number 26
February 2025
Pages 110-127

Files

History

  • Receive Date: 28 August 2023
  • Revise Date: 26 November 2023
  • Accept Date: 18 December 2023

Share

How to cite

Statistics