کاربرد روش تحلیل پوششی داده‌ها (DEA) برای سنجش و ارزیابی عملکرد پژوهشگران سازمان‌های تحقیقاتی: مطالعه موردی یک مرکز تحقیقاتی

نوع مقاله : مقاله پژوهشی

نویسندگان

1 دانشکده مهندسی برق و کامپیوتر، دانشگاه صنعتی قم، قم، ایران.

2 دانشکده مهندسی صنایع، دانشگاه صنعتی مالک اشتر، تهران، ایران.

3 دانشکده فنی و مهندسی، دانشگاه صنعتی قم، قم، ایران.

چکیده

هدف از این تحقیق ارائه یک روش ساختاریافته برای ارزیابی عملکرد پژوهشگران در سازمان‌های تحقیقاتی با استفاده از تحلیل پوششی داده‌ها بر اساس شاخص‌های عینی، دقیق و روشن است. جهت انجام این کار پس از تهیه پرسشنامه از طریق مطالعه ادبیات و مصاحبه با نخبگان، داده‌های جمع‌آوری شده از محققان یک مرکز تحقیقاتی، مورد تجزیه‌وتحلیل قرار گرفته و شاخص‌های ورودی و خروجی موثر بر کارایی پژوهشگران با کمک روش تحلیل پوششی داده‌ها معین شده است. بر اساس روش پیشنهادی، پژوهشگران با دریافت ورودی از مراکز و سازمان‌های تحقیقاتی، خروجی‌هایی را در اختیار چنین سازمان‌ها و مراکزی قرار می‌دهند که با استفاده از آنها عملکرد و کارایی پژوهشگران اندازه‌گیری می‌شود تا از چنین ارزیابی‌هایی در برابر اشتباهات انسانی محافظت شود که ممکن است نتایج ارزیابی را تغییر دهد. روش پیشنهادی در یک مرکز تحقیقاتی بر روی 56 محقق با 4 شاخص ورودی و 10 شاخص خروجی، اجرا و نتایج نشان می‌دهد که نمره کارایی 11 محقق 1 بوده و سایر محققان نمرات کمتر از 1 داشتند و کارایی آنها در مقایسه با 11 نفر اول اندازه‌گیری شد. ویژگی بارز تحقیق در مقایسه با سایر کاوشگرها جامعیت و یکپارچگی این روش برای ارزیابی عملکرد این‌گونه محققین است زیرا از کلیه شاخص‌های موجود در ادبیات در این روش استفاده شده است.

کلیدواژه‌ها

موضوعات


عنوان مقاله [English]

The application of DEA for the sake of assessing and evaluating the performance of researchers at research institutes: Case study of a research center

نویسندگان [English]

  • Mehdi Jabbari 1
  • Reza Hosnavi 2
  • Mohammad Mohammadi 2
  • Peyman Akhavan 3
1 Department of computer science, Qom university of technology, Qom. Iran.
2 Industrial Engineering Department, Malek Ashtar University of Technology, Tehran, Iran.
3 Department of Industrial Engineering , Qom university of technology, Qom. Iran.
چکیده [English]

The purpose of this research is to provide a structured method to evaluate the performance of researchers in research organizations using data coverage analysis based on objective, accurate, and precise indicators. To do this, after preparing a questionnaire by studying the literature and interviewing elites, the data collected from the researchers of a research center has been analyzed, and the input and output indicators affecting the efficiency of the researchers have been determined with the help of the data envelopment analysis method. The proposed method in a research center on 56 researchers with four input indicators and ten output indicators, implementation, and results show that the efficiency score of 11 researchers was one, and other researchers had scores less than one, and their efficiency was measured compared to the first 11 people.

کلیدواژه‌ها [English]

  • Assessment and performance appraisal
  • Research organizations’ researchers
  • Data Envelopment Analysis (DEA)
  • questqnirion
  • dea
[1] M.E. Warner, C. Hinrichs, J. Schneyer, and L. Joyce, “From knowledge extended to knowledge created: Challenges for a new extension paradigm,” J. Ext., vol. 36, no. 4, 1998.
[2] A. Afkhami, A. Maleki, M. A. Zolfi Gol, and D. Nematzadeh, “A look at the COMSTECH report on introducing prominent researchers and engineers of Islamic conference member countries,” Rahyaft, vol. 19, no. 44, pp. 42-48, 2009 [In Persian].
[3] M. Mehregaan and M. Zaali, “In search of a model for evaluating the performance of research and development organizations,” Manag. Studi. Dev. Evol., vol. 10, no. 39-40, pp. 123-153, 2004, dor: 20.1001.1.22518037.1382.10.39.40.6.8 [In Persian].
[4] E.W. Said, The Selected Works of Edward Said 1996-2006, Vintage, ISBN 978-0525565314, 2019.
[5] S.M. Farhadi, M.M. Rashidi, and Gh.R. Asili, “Performance Management Model and its New Challenges on the Iranian R&D,” Quarterly J. Res. Plan. Hig. Educ., vol. 10, no. 4, pp. 151-174, 2004 [In Persian].
[6] A. Soltani, Developing Human Capital, Arkan-e Danesh, 2013 [In Persian].
[7] S. Sadraei and R. Behradi Yekta, “A Criticize on Booklet of Research and Technology Performance Evaluation of Universities and Research Institutes in 2005 & 2006,” Roshd-e-Fanavari, vol. 5, no. 17, pp. 1-10, 2009 [In Persian].
[8] R. Mahdi, “Development of Commercialization of the Scientific Achievements through Pilot Plant Research,” Roshd-e-Fanavari, vol. 6, no. 24, pp. 1-10, 2010 [In Persian].
[9] A. Negahban and F. Mostajabi, Research Methodology Guide Using Questionnaires, Tehran, Jahad Daneshgahi Publications, 2005 [In Persian].
[10] G. Chirici, “Assessing the scientific productivity of Italian forest researchers using the Web of Science, SCOPUS and SCIMAGO databases,” iForest-Biogeosci. Forestry, vol. 5, no. 3, p. 101, 2012.
[11] B. Lak, S. Bakhtiari, and S.M. Rezvani, “Selection of the optimal conversation algorithm in the Internet context based on simulation,” vol. 2, no. 4, pp. 25-39, 2021, doi: 10.22034/pitc.2021.208213.1053 [In Persian].
[12] M. Niaei, J. Tanha, G. Shahmohammadi, and A. Poorebrahimi, “A model for Multi-Class Intrusion Detection Using the Dragonfly Feature Selection by Learning on the KDD-CUP99 Dataset,” Electron. Cyber Def., vol. 10, no. 3, pp. 33-42, 2022, dor: 20.1001.1.23224347.1401.10.3.4.2 [In Persian].
[13] M. Meyer, R.W. Waldkirch, and M.A. Zaggl, “Relative performance measurement of researchers: The high impact of data source selection,” Schmalenbach Bus. Rev., vol. 13, no. 4, pp.308-330, 2012, doi: 10.1007/BF03396844.
[14] J. Altmann, A. Abbasi, and J. Hwang, "Evaluating the productivity of researchers and their communities: The RP-index and the CP-index," TEMEP Discussion Papers 201048, Seoul National University; Technology Management, Economics, and Policy Program (TEMEP), 2010.
[15] C.L. Ubeda and F.C.A. Santos, “Staff development and performance appraisal in a Brazilian research centre,” Eur. J. Innov. Manag., vol. 10, no. 1, pp. 109-125, 2007.
[16] H. Samavati and S.A. Nejat, “Investigating the performance evaluation system of NAJA employees from the perspective of managers,” Police Hum. Dev., vol. 6, no. 22, pp. 19-49, 2009. [In Persian]
[17] A. Pourhabib Yekta and M. Maghbouli, “Performance measurement in data envelopment analysis: a BCC-based approach,” J. Decis. Operat. Res., vol. 8, no. 3, pp. 800-813, 2023, doi: 10.22105/dmor.2023.350160.1631 [In Persian].
[18] A. Hosseinpoor, A. Ghorbanpour, and H. Shabandarzadeh, “Evaluating the Efficiency of Circular Economies in Persian Gulf Countries in Terms of Municipal Solid Waste Management,” Quarterly J. Quant. Econ., vol. 21, no. 1, pp. 87-106, 2024, doi: 10.22055/jqe.2023.42312.2523 [In Persian].
[19] F. Saghafi, M. Momeni, M. Tahari Mehrjerdi, and M. Baghaei, “Measuring the efficiency of technology units in strategic industries from the perspective of regional development (Case Study: Food Industries of Razavi Khorasan Province),” Manag. Improv., vol. 16, no. 4, pp. 1-22, 2022, doi: 10.22034/jmi.2022.345737.2789 [In Persian].
[20] N. Bagheri Mazraeh, M. Rostami Mal Khalife, and M. Varzi, “A comparison of super-efficiency through data envelopment analysis technique and financial ratios in Iranian stock exchange banks,” J. Decis. Operat. Res., vol. 6 (Special Issue), pp. 1-16, 2022, doi: 10.22105/dmor.2021.236731.1163 [In Persian]. 
[21] H. Azizi, “Supplier Performance Evaluation Using a Nonparametric Approach,” Mod. Res. Perform. Eval., vol. 1, no. 1, pp. 31-41, 2022, doi: 10.22105/mrpe.2022.140221 [In Persian].
[22] S. Mirsadeghpour Zoghi, M. Sanei, G. Tohidi, S. Banihashemi, and N. Modarresi, “Assets performance evaluation with the use of returns distribution characteristics,” J. Decis. Operat. Res., vol. 8, no. 3, pp. 771-784, 2023, doi: 10.22105/dmor.2022.332170.1587 [In Persian].
[23] S.H. Hajiagha, H. Amoozad Mahdiraji, S.S. Hashemi, J.A. Garza-Reyes, and R. Joshi, “Public hospitals performance measurement through a three-staged data envelopment analysis approach: Evidence from an emerging economy,” Cybernetics Syst., vol. 54, no. 1, pp. 1-26, 2023.
[24] I. Costa Melo et al., “A performance index for traditional retailers incorporating digital marketplace: Benchmarking through data envelopment analysis (DEA),” J. Org. Comput. Electron. Commer., pp. 1-21, 2023.
[25] C.C. Kang, C.M. Feng, P.F. Chou, W.M. Wey, and H.A. Khan, “Mixed network DEA models with shared resources for measuring and decomposing performance of public transportation systems,” Res. Transp. Bus. Mgmt., vol. 46, p. 100828, 2023.
[26] Y. Sun, D. Wang, F. Yang, and S. Ang, “Efficiency evaluation of higher education systems in China: A double frontier parallel DEA model,” Comput. Ind. Eng., vol. 176, p. 108979, 2023.
[27] T.C.C. Nepomuceno, A.P.C.S. Costa, and C. Daraio, “Theoretical and empirical advances in the assessment of productive efficiency since the introduction of DEA: A bibliometric analysis,” Int. J. Operat. Res., vol. 46, no. 4, pp. 505-549, 2023.
[28] B.T. Yen, M.J. Huang, H.J. Lai, H.H. Cho, and Y.L. Huang, “How smart port design influences port efficiency–a dea-tobit approach,” Res. Transp. Bus. Mgmt., vol. 46, p. 100862, Jan. 2023.
[29] M. Bashokouh and I. Ghasemi Hamedani, “Investigation the effect of knowledge management on the performance and loyalty of employees with the moderating role of innovation (case study: employees of Tabriz Petrochemical Company),” Strateg. Manag. Organ. Knowl., vol. 5, no. 4, pp. 75-109, 2022, doi: 10.47176/smok.2022.1481 [In Persian].
[30] M. Babaee Farsani, S. Fathollahi, and M. Moradi, “The Analysis of the Knowledge -Based Leadership Relationship, Knowledge Management Behavior and Innovation Performance (Case Study: Small and Medium Companies of Chaharmahal & Bakhtiari Province),” Strateg. Manag. Organ. Knowl., vol. 5, no. 1, pp. 135-163, 2022, doi: 10.47176/smok.2022.1394 [In Persian].
[31] H. Homaypour, A. Monvarian, and R. Gholipour, “Designing a Performance Evaluation Model for Mobile Telecommunication Company of Iran with a Knowledge-Based Organization Approach,” Strateg. Manag. Organ. Knowl., vol. 4, no. 1, pp. 155-195, 2021, doi: 10.47176/smok.2021.1258 [In Persian].
[32] S. Amiri, N. Nikkam, and M. Sahebinejad, “Statistical Survey of Nanotechnology related Patents as an Indicator of Nanotechnology Creation,” J. Sci. Technol. Policy, vol. 1, no. 3, pp. 1-13, 2008, dor: 20.1001.1.20080840.1387.1.3.2.2 [In Persian].
[33] A. Charnes, W.W. Cooper, and E. Rhodes, “Measuring the efficiency of decision making units,” Eur. J. Operat. Res., vol. 2, no. 6, pp. 429-444, Nov. 1978.