How Effective is Altmetrics for Assessing a Specialist's Scientific Contributions?
Authors/Creators
- 1. Peter the Great St. Petersburg Polytechnic University
Description
Introduction. The article explores the effectiveness of altmetrics for assessing the scientific contributions of universities' teaching staff and research institutes' personnel. The article's goal is to identify the altmetric indicators (indices) that are least susceptible to fluctuations and manipulations, while providing valuable insights into a specialist's real achievements. Methods. The article analyses altmetrics as a unique branch of scientometrics in terms of its effectiveness for assessing scientific contributions of a scientist with a focus on the general theoretical and practical research methods, including content analysis and bibliographic coupling. Results and Discussion. Altmetrics has repeatedly garnered attention of foreign and Russian scientists, primarily for its theoretical implications. This article attempts to identify and substantiate several altmetric indicators that could serve as additional indicators for generation of a specialist's detailed scientometric profile. Conclusion. Research indicates that altmetric scores from specialised academic platforms like ResearchGate and Academia.edu are most suitable for forming a scientific rating for researchers, albeit with some reservations. The country-index provides the most stable and reliable data in various configurations, as it is next to impossible to secure enquiries and uploads from dozens of countries by improper manipulations. Thus, the country-index reliably reflects a specialist's international recognition with a high degree of objectivity. Altmetrics has a certain potential for developing a scientometric profile of a scientists, and some of its data may already serve as additional indicators, whether they are adopted by the administration of the university / research institute.
Files
424-451 Гринёв.pdf
Files
(853.3 kB)
| Name | Size | Download all |
|---|---|---|
|
md5:ea938a395a0d8d700852c0504589d3e7
|
853.3 kB | Preview Download |
Additional details
Dates
- Submitted
-
2024-03-16
- Accepted
-
2024-06-06
References
- Akoev MA, Markusova VA, Moskaleva OV, Pislyakov VV. Handbook on Scientometrics: Science and Technology Development Indicators, Second Edition : a monography / ed by M. A. Akoev. Yekaterinburg: IPC UrFU, 2021. 358 p. DOI: https://doi.org/10.15826/B978-5-7996-3154-3 (In Russ.)
- Lazarev VS. Bibliometrics, Scientometrics and Informetrics. Part 4. Methods. Science Management: Theory and Practice. 2021;4(1):180-214. DOI: https://doi.org/10.19181/smtp.2022.4.1.10 (In Russ.)
- Minenko VG, Romanov DA, Shaposhnikov VL. The Relationship between Scientometrics and Science Management. Kazan Pedagogical Journal. 2023;2:235-242. DOI: https://doi.org/10.51379/KPJ.2023.159.2.031 (In Russ.)
- Chebotarev PYu. The Use of Scientometrics: How to Help, not Hurt? Large-Scale Systems Control. Special Issue no. 44 "Scientom etrics and Expertise in Science Governance". 2013;14-31. Available at: https://cyberleninka.ru/article/n/naukometriya-kak-s-eyo-pomoschyu-lechit-a-ne-kalechit?ysclid=lvdkn65nc4232960383 (accessed: 11.03.2024). (In Russ.)
- Games Academics Play and their Consequences: How Authorship, H-Index and Journal Impact Factors are Shaping the Future of Academia / C. A. Chapman [et al.] // Proceedings of the Royal Society B. 2019;286(1916). Article number: 20192047. DOI: http://dx.doi.org/10.1098/rspb.2019.2047
- Hicks D, Wouters P, Waltman L, de Rijcke S, Rafols I. Bibliometrics: The Leiden Manifesto for Research Metrics. Nature. 2015;520:429-431. DOI: https://doi.org/10.1038/520429a
- Fradkov AL. The Splendors and Miseries of Scientific Expertise Formal Criteria. Large-Scale Systems Control. Special Issue no. 44 "Scientometrics and Expertise in Science Governance". 2013:346-360. Available at: https://cyberleninka.ru/article/n/blesk-i-nischeta-formalnyh-kriteriev-nauchnoy-ekspertizy?ysclid=lvdmbc24ov48537553 (accessed: 11.03.2024). (In Russ.)
- Tarakanov VV, Dragavtsev VA. Russian Criterion of Publication Activity (Project). Herald of the Russian Academy of Sciences. 2021;91(3):253-256. Available at: https://sciencejournals.ru/cgi/getPDF.pl?jid=vestnik&year=2021&vol=91&iss=3&file=Vestnik2102009Tarakanov.pdf (accessed: 11.03.2024). (In Russ.)
- Hirsch JE. An Index to Quantify an Individual's Scientific Research Output. Proceedings of the National Academy of Sciences. 2005;102(46):16569-16572. DOI: https://doi.org/10.1073/pnas.0507655102
- Grinev AV. The Problem of Scientometric Assessment of Monographs in Modern Russia. Sociology of Science and Technology. 2024;15(1):106-125. DOI: https://doi.org/10.24412/2079-0910-2024-1-106-125 (In Russ.)
- Tsvetkova VA, Mokhnacheva YuV. Russian Science and Russian Book Publishing in Digits and Bibliometric Estimates. Scientific and Technical Libraries. 2022;11:29-55. DOI: https://doi.org/10.33186/1027-3689-2022-11-29-55 (In Russ.)
- Grinёv AV. The Problem of Scientometric Discrimination of Russian Humanities Scholars. Herald of the Russian Academy of Sciences. 2019;89(10):993-1002. DOI: https://doi.org/10.31857/S0869-58738910993-1002 (In Russ.)
- Grinev AV. The Problem of Scientometric Discrimination of Russian Humanities Scholars. Sociology of Science and Technology. 2023;14(2):122-143. DOI: https://doi.org/10.24412/2079-0910-2023-2-122-143 (In Russ.)
- Do Altmetric Scores Reflect Article Quality? Evidence from the UK Research Excellence Framework 2021 / M. Thelwall [et al.]. Journal of the Association for Information Science and Technology. 2023;74(5):582- 593. DOI: https://doi.org/10.1002/asi.24751
- Thelwall M, Maflahi N. Research Coauthorship 1900-2020: Continuous, Universal, and Ongoing Expansion. Quantitative Science Studies. 2022;3(2):331-344. DOI: https://doi.org/10.1162/qss_a_00188
- Trubnikova ЕI. The Exchange of Gifts in the Academic Sphere: Predatory Practices, False Signals, and Conflicts of Interest in Excellence Programs. Mir Rossii. 2022;31(1):25-48. DOI: https://doi.org/10.17323/1811-038X-2022-31-1-25-48 (In Russ.)
- Efimova GZ. Co-Authorship or Sole Authorship: Tradition or Freedom of Choice? Sociology of Science and Technology. 2022;13(1):130-148. DOI: https://doi.org/10.24412/2079-0910-2022-1-130-148 (In Russ.)
- Holcombe AO. Contributorship, not Authorship: Use CRediT to Indicate Who Did What // MDPI Publications. 2019;7(3). Paper No. 48. P. 1-11. DOI: https://doi.org/10.3390/publications7030048
- Grinev AV. The Scientometric Portrait of a Scientist as a Tool to Assess His or Her Achievements. Herald of the Russian Academy of Sciences. 2022;92(4):339-349. Available at: https://sciencejournals.ru/cgi/getPDF.pl?jid=vestnik&year=2022&vol=92&iss=4&file=Vestnik2202004Grinev.pdf (accessed: 14.04.2023). (In Russ.)
- Peters I, Kraker P, Lex E, Gumpenberger C, Gorraiz J. Research Data Explored: an Extended Analysis of Citations and Altmetrics. Scientometrics. 2016;107(2):723-744. DOI: https://doi.org/10.1007/s11192-016-1887-4
- Ortega J.-L. Altmetrics Data Providers: a Meta-Analysis Review of the Coverage of Metrics and Publications. El Profesional de la Información. 2020; Vol. 29, № 1. Article number: e290107. DOI: https://doi.org/10.3145/epi.2020.ene.07
- Karmakar M, Banshal SK, Singh VK. A Large-Scale Comparison of Coverage and Mentions Captured by the two Altmetric Aggregators — Altmetric.com and PlumX. Scientometrics. 2021;126(5):4465-4489. DOI: https://doi.org/10.1007/s11192-021-03941-y
- Thelwall M. A brief History of Altmetrics. Research Trends. 2014; Vol. 1. Issue 37. Article number: 2. Available at: https://www.researchtrends.com/cgi/viewcontent.cgi?article=1170&context=researchtrends (accessed: 14.04.2023).
- Busygina TV. Altmetrics as a Complex of New Tools for the Scientific Activity Products Evaluation. Ideas & Ideals. 2016;2(2):79-87. Available at: https://cyberleninka.ru/article/n/altmetriya-kak-kompleks-novyh-instrumentov-dlya-otsenki-produktov-nauchnoy-deyatelnosti?ysclid=lvdv4bvvhp435413084 (accessed: 14.04.2023). (In Russ.)
- Goncharov MV, Kolosov KA. Calculating Altmetrics Based on the Data Obtained at Users' Accessing Library E-Catalogs. Scientific and Technical Libraries. 2020;11:73-88. DOI: https://doi.org/10.33186/1027-3689-2020-11-73-88 (In Russ.)
- Lazarev VS. The Power of Bibliometric Illusions Over the Lazy, the Profanation of Fruitful Ideas and the Curse of Parabibliometric Evaluation of Science. Science Editor and Publisher. 2019;4(1-2):12-20. DOI: https://doi.org/10.24069/2542-0267-2019-1-2-12-20 (In Russ.)
- Bornmann L, Haunschild R. Do Altmetrics Correlate with the Quality of Papers? A Large-Scale Empirical Study Based on F1000Prime data. PLoS ONE. 2018;13(5):e0197133. DOI: https://doi.org/10.1371/journal.pone.0197133
- Costas R, Zahedi Z, Wouters P. Do 'Altmetrics' Correlate with Citations? Extensive Comparison of Altmetric Indicators with Citations from a Multidisciplinary Perspective. Journal of the Association for Information Science and Technology. 2015;66(10):2003-2019. DOI: https://doi.org/10.1002/asi.23309
- De Filippo D, Sanz-Casado E. Bibliometric and Altmetric Analysis of Three Social Science Disciplines. Frontiers in Research Metrics Analytics. 2018; Vol. 3. Article number: 34. DOI: https://doi.org/10.3389/frma.2018.00034
- Hammarfelt B. Using Altmetrics for Assessing Research Impact in the Humanities. Scientometrics. 2014;101(2):1419-1430. DOI: https://doi.org/10.1007/s11192-014-1261-3
- Fang Z, Costas R. Studying the Accumulation Velocity of Altmetric Data Tracked by Altmetric.com. Scientometrics. 2020;123(2):1077-1101. DOI: https://doi.org/10.1007/s11192-020-03405-9
- Mazov NA, Gureev VN Alternative Approaches to Assessing Scientific Results. Herald of the Russian Academy of Sciences. 2015;85(2):115-122. Available at: http://www.ipgg.sbras.ru/ru/science/publications/article-journal-alternativnye-podkhody-k-otsenke-nauchnykh-2015-043242 (accessed: 14.04.2023). (In Russ.)
- Torres-Salinas D, Robinson-García N, Arroyo-Machado W. Coverage and Distribution of Altmetric Mentions in Spain: a CrossCountry Comparison in 22 Research Fields. Profesional de la Información. 2022;31(2):e310220. DOI: https://doi.org/10.3145/epi.2022.mar.20
- Thelwall M. The Pros and Cons of the Use of Altmetrics in Research Assessment. Scholarly Assessment Reports. 2020; Vol. 2. Issue 1. Article 2. DOI: https://doi.org/10.29024/sar.10
- Nikolaenko GA. In Search of Balanced Internet Metrics of Scientific Activities: An Example of RG Score. Monitoring of Public Opinion: Economic and Social Changes. 2019;4:225-244. DOI: https://doi.org/10.14515/monitoring.2019.4.11 (In Russ.)
- Gasilin AV. Academia.edu: Marketing of Social Networks as the Novum Organum of Open Science. Philosophical Problems of IT & Cyberspace (PhilIT&C). 2018;1:73-91. DOI: https://doi.org/10.17726/philIT.2018.1.5 (In Russ.)
- Markusova VA, Libkind AN, Bogorov VG, Mindeli LE. The Rate of Altmetric as One of the Indicators of Publications Scientific Impact. Herald of the Russian Academy of Sciences. 2018;88(9):811-818. DOI: https://doi.org/10.31857/S086958730001694-1 (In Russ.)
- Chesnyalis PA. Altmetrics: The awareness and interest. Scientific and Technical Libraries. 2021;1(1):27-40. DOI: https://doi.org/10.33186/1027-3689-2021-1-27-40 (In Russ.)
- Dushina SA, Kupriyanov VA, Khvatova TYu. Academic Social Media as a Representation of the "Open Science". Sociology of Science and Technology. 2018;9(3):80-98. DOI: https://doi.org/10.24411/2079-0910-2018-10015 (In Russ.)
- Chesnyalis PA. Use of Altmetrics in Bibliographic Services. Proceedings of SPSTL SB RAS. 2020;1:79-85. DOI: https://doi.org/10.20913/2618-7515-2020-1-79-85 (In Russ.)
- Grinev AV. Country Index as a Synthesis of Scientometrics, Geography and International Reputation. Sociology of Science and Technology. 2022;13(4):202-220. DOI: https://doi.org/10.24412/2079-0910-2022-4-202-220 (In Russ.)