Monitoring and assessment of scientific performance: foreign experience and Russian practice
Authors/Creators
Description
The article provides the analysis of approaches to monitoring and assessment of scientiic organizations in the Russian Federation and abroad. It describes the experience in evaluating performance of scientiic organizations and scientists in the countries of the European Union, U.S. and China. The analysis of foreign experience has shown that currently the reform of the approaches to the scientiic performance assessment is actively held, which is based on: the transition from the quantitative analysis of scientometric indicators to the qualitative evaluation of R&D; assessing the social efect of R&D; the combination of internal and external audit of scientiic performance; the transition to the budgeting system based on accounting the results of the activity. Special attention is paid to the diagnostic system of implementation of the so-called ‘‘One-three-ive’’ principle of state science and technology policy which is used under the system of evaluating the scientiic performance in China. The article identiies the problems of the Russian system of monitoring and evaluation of scientiic performance, which are mostly due to the methodological laws of collecting and analyzing data on the performance of scientiic organizations, the incoherence of the systems of expert and scientometric evaluation and the increasing bureaucratic burden on the organizations. It concludes that for developing the system of scientiic performance evaluation in Russia it is necessary to achieve the following objectives: to deine the place and role of information systems in the public administration of science and technology policy, create a system of target setting for the research organizations to develop an efective mechanism for collecting data on scientiic activity. The authors believe that the compulsory element of the assessment system should be an expert examination based on quantitative indicators.
Notes
Files
Monitoring and assessment of scientific performance foreign experience and Russian practice. Gusev et al. 2018-1.pdf
Files
(6.7 MB)
| Name | Size | Download all |
|---|---|---|
|
md5:65b0a5f6a90298adab22b877d6dd3579
|
6.7 MB | Preview Download |
Additional details
References
- NALIMOV, V. V., MULCHENKO, Z. M. (1969) Scientometrics. The study of the development of science as an information process. Moscow: Nauka. (In Russian)
- ERAC. (2016) Action plan ERA Priority. ERAC. Available at: https://era.gv.at/object/document/2505/attach/Item_4_3_ Compliation_of_outlines_of_national_action_plans.pdf [Accessed 15 December 2017]. (In Russian)
- VAN DAALEN, R., MEHMOOD, S., VERSTRATENe, P. and VAN DER WIEL, K. (2014) Public funding of science: An international comparison. CPB Netherlands Bureau for Economic Policy Development, The Hague.
- JONKERS, K. et al. (2016) Research performance based funding systems: a comparative assessment. Institute for Prospective Technological Studies, Joint Research Centre. Available at: http:// publications.jrc.ec.europa.eu/repository/bitstream/JRC101043/ kj1a27837enn.pdf [Accessed 10 December 2017].
- GLÄSER, J., LAUDEL, G. (2016) Governing Science. European Journal of Sociology. 57 (1). P. 117–168.
- CATTANEO, M., MEOLI, M. and SIGNORI, A. (2016) Performance-based funding and university research productivity: the moderating efect of university legitimacy. The Journal of Technology Transfer. 41 (1). P. 85–104.
- VANECEK, J. (2014) The efect of performance-based research funding on output of R&D results in the Czech Republic. Scientometrics. 98 (1). P. 657–681.
- GOOD, B., VERMEULEN, N., TIEFENTHALER, B. and ARNOLD, E. (2015) Counting quality? The Czech performance- based research funding system. Research Evaluation. 24 (2). P. 91–105.
- OECD. (2008) Reviews of Innovation Policy: China. Paris: OECD Publishing.
- HUANG, C., JIN, X. and Li, L. (2016) Rio country report 2015: China. European Union.
- HU, Y., LIANG, W. and TANG, Y. (2017) Evaluating Research Eiciency of Chinese Universities, New Frontiers of Educational Research. Springer Nature Singapore Pte Ltd.
- XU, F., LI, X. (2016) The changing role of metrics in research institute evaluations undertaken by the Chinese Academy of Sciences (CAS). Palgrave Communications. No. 2. P. 1–6.
- BELINSKIJ, A. N., EMEL'JANOV, S. V., STALINSKIJ, V. S. (2008) The Government and R&D in the USA: priorities for inancing in the early 21st century. Rossija i Amerika v XXI veke [Russia and America in the 21st century]. No 3. Available at: http:// www.rusus.ru/?act=read&id=97 [Accessed 10 December 2017]. (In Russian)
- FEDOROVICH, V. A., PATRON, A. P. (2007) USA. The government and the economy. Moscow: International relations. (In Russian)
- RUEGG, R., JORDAN, G. (2007) Overview of evaluation methods for R&D programs. A directory of evaluation methods relevant to technology development programs, prepared for US Department of Energy, Oice of Energy Eiciency and Renewable Energy.
- RUEGG, R. (2003) Benchmarking evaluation of public science and technology programs in the United States, Canada, Israel, and Finland, Proceedings of a workshop held at the embassy of Finland on September 25, 2002. Washington, DC. Available at:https://wenku.baidu.com/view/8230a76ba98271fe910ef93b. html [Accessed 10 December 2017].
- RUSSIA. GOVERNMENT OF THE RUSSIAN FEDERATION. (2009) Decree No. 312 of 08.04.2009 (ed. of 29.12.2016) On evaluation and monitoring the efectiveness of the scientiic organizations conducting civilian research and development for civilian designation. ConsultantPlus legal reference system. (In Russian)
- RUSSIA. MINISTRY OF EDUCATION AND SCIENCE OF RUSSIA. (2014) Order No. 162 of 05.03.2014 (ed. of 03.03.2016) On approval of the procedure for providing information on the performance results by the scientiic organizations conducting research and development for civilian designation and the procedure for conirming this information by the federal executive authorities for the purposes of monitoring, the procedure for providing information on the performance results by the scientiic organizations conducting research and development for civilian designation for the purposes of evaluation, and the scope of information on the performance results of the scientiic organizations conducting research and development for civilian designation provided for monitoring and evaluation. ConsultantPlus legal reference system. (In Russian)
- RUSSIA. GOVERNMENT OF THE RUSSIAN FEDERATION. (2014) Decree No. 1195 of 14.11.2014 On providing by the scientiic organizations and educational organizations of higher education conducting basic research at the expense of budgetary funds the reports to the Russian Academy of Sciences on the carried out basic research and on the received scientiic and technical results (together with ''The rules of providing by the scientiic organizations and educational institutions of higher education conducting basic research at the expense of budgetary funds Russian Academy of Sciences the reports on the carried out basic research and on the received scientiic and technical results''). ConsultantPlus legal reference system. (In Russian)
- RUSSIA. PRESIDENT OF THE RUSSIAN FEDERATION. (2016) Decree No. 642 of 01.12.2016 On the Strategy for the scientiic and technological development of the Russian Federation. ConsultantPlus legal reference system.
- OECD. (2015) Frascati Manual 2015: Guidelines for Collecting and Reporting Data on Research and Experimental Development. Paris: OECD Publishing.