How Evaluation Systems Quietly Steer Academic Trajectories

Authors

  • Dasari Vinay Author

Keywords:

Experiential Audit, Research Funding, CARE List, API List, Promotion Norms, Workload Distribution, COVID-19, Careers, Research Choices, Equity, Policy Reform.

Abstract

Scholarly research is by and large an outcome of funding received by individual or collaborative efforts. The criteria of major funding agencies in a region place constraints on not only contemporary research choices but also on intellectual development over longer career trajectories. Many funders have their focus areas predetermined to address topical challenges of societal relevance, and these areas receive higher priority. Consequently, research by a larger number of scholars falls outside priority areas, that research is often beyond the spotlight and appears to move at a slow pace. The political parties in power and their support agencies taste success only when high-profile issues are attended to, albeit in the form of big-bang solutions. Since there is always a plethora of problems in the country, funding priority areas tend to be repetitive over different funding calls. The normative aspect of funding agencies in a country-and its intensity act as a guiding compass to steer the direction of research, irrespective of an individual’s intellectual aspiration.

The lists drawn up by API and CARE committees place undue importance on the quantity of research publications, irrespective of the funding and nature of research. Even simple research studies that require no more than a year of work and intellectual thought are found to be published in bulk. Quality is compromised for quantity. Care is taken to ensure that these publications appear in journals that find a place in the API/CARE lists. The nature of promotion and appointee selection norms need not be explained, as these are the common expectations for attaining recognizable success in an academic career. The pattern of workload distribution also has a significant role to play in influencing research direction. An unequal share of class and administrative work prevents these individuals from investing quality time in research. Given the importance of these issues, an experiential audit was conducted to ascertain whether or to what extent funding norms, the API/CARE list, promotion criteria, and workload distribution influence research choices.

References

1. Amutuhaire, T. (2022). The reality of the “publish or perish” concept, perspectives from the Global South. Publishing Research Quarterly, 38, 281–294.

2. Anderson, C. G., McQuaid, R. W., & Wood, A. M. (2022). The effect of journal metrics on academic resume assessment. Studies in Higher Education, 47(11), 2310–2322.

3. Bowering, E., & Reed, M. (2021). Achieving academic promotion: The role of work environment, role conflict, and life balance. Canadian Journal of Higher Education, 51(4), 1–25.

4. Mattaparthi, R. (2023). Deep Learning-Driven Combustion Anomaly Detection in Diesel Powertrains: A Multi-Sensor Fusion Approach for Real-Time ECM Adaptation. International Journal of Intelligent Systems and Applications in Engineering, 11, 1084.

5. Carli, G., & Tagliaventi, M. R. (2023). Can you do all in one professional label? Complementarity, substitution, and independence effects in academic life. Higher Education, 85, 837–863.

6. Eckhaus, E., & Davidovitch, N. (2021). Academic rank and position effect on academic research output: A case study of Ariel University. International Journal of Higher Education, 10(1), 295–305.

7. Franssen, T. (2022). Enriching research quality: A proposition for stakeholder heterogeneity. Research Evaluation, 31(3), 311–320.

8. Mangala, N. (2022). Implementing Databricks Unity Catalog For Centralized Data Governance In Multi-Business-Unitenterprises. Journal of International Crisis and Risk Communication Research, 101-122.

9. Hammarfelt, B. (2022). Assessing academic careers: The peer review of professorial candidates. In E. Forsberg, L. Geschwind, S. Levander, & W. Wermke (Eds.), Peer review in an era of evaluation (pp. 347–370). Palgrave Macmillan.

10. Langfeldt, L., Reymert, I., & Aksnes, D. W. (2021). The role of metrics in peer assessments. Research Evaluation, 30(1), 112–126.

11. Liu, D., Xu, Y., Zhao, Y., & Che, S. (2022). Academic career development of Chinese returnees with overseas Ph.D. degrees: A bioecological development perspective. Frontiers in Psychology, 13, 859240.

12. Ma, H., Chu, F.-Y., Chen, T.-J., & Hwang, S.-J. (2021). Academic promotion of physicians in medical schools: A special focus on primary health care in Taiwan. International Journal of Environmental Research and Public Health, 18(18), 9615.

13. Kolla, S. H., & Loganathan, R. (2023). Cloud-Native Deep Learning Architectures For Secure Generative AI Deployment In Enterprise Workflow Platforms. Journal of International Crisis and Risk Communication Research, 603-618.

14. Marini, G. (2021). Coercive and mimetic isomorphism as outcomes of authority reconfigurations in French and Spanish academic career systems. Policy Reviews in Higher Education, 5(1), 89–108.

15. Morales, E., McKiernan, E. C., Niles, M. T., Schimanski, L., & Alperin, J. P. (2021). How faculty define quality, prestige, and impact of academic journals. PLOS ONE, 16(10), e0257340.

16. Yandamuri, U. S. (2023). An Intelligent Analytics Framework Combining Big Data and Machine Learning for Business Forecasting. International Journal Of Finance, 36(6), 682-706.

17. Nästesjö, J. (2021). Navigating uncertainty: Early career academics and practices of appraisal devices. Minerva, 59, 237–259.

18. Pagliaro, M. (2021). Purposeful evaluation of scholarship in the open science era. Challenges, 12(1), 6.

19. Pinar, M., & Horne, T. J. (2022). Assessing research excellence: Evaluating the Research Excellence Framework. Research Evaluation, 31(2), 173–187.

20. Syed, S. (2023). Shaping The Future Of Large-Scale Vehicle Manufacturing: Planet 2050 Initiatives And The Role Of Predictive Analytics. Nanotechnology Perceptions, 19(3), 103-116.

21. Pontika, N., Klebel, T., Correia, A., Metzler, H., Knoth, P., & Ross-Hellauer, T. (2022). Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries. Quantitative Science Studies, 3(4), 888–911.

22. Reymert, I., Jungblut, J., & Borlaug, S. B. (2021). Are evaluative cultures national or global? A cross-national study on evaluative cultures in academic recruitment processes in Europe. Higher Education, 82, 823–843.

23. Smit, J. P., & Hessels, L. K. (2021). The production of scientific and societal value in research evaluation: A review of societal impact assessment methods. Research Evaluation, 30(3), 323–335.

24. Strinzel, M., Brown, J., Kaltenbrunner, W., de Rijcke, S., & Hill, M. (2021). Ten ways to improve academic CVs for fairer research assessment. Humanities and Social Sciences Communications, 8, 251.

25. Mangalampalli, B. M. (2023). AI-Driven Anomaly Detection in Healthcare Claims Data: A Business Intelligence Perspective. Journal of Rare Cardiovascular Diseases.

26. Tie, Y., & Wang, Z. (2022). Publish or perish? A tale of academic publications in Chinese universities. China Economic Review, 73, 101769.

27. van Dalen, H. P. (2021). How the publish-or-perish principle divides a science: The case of economists. Scientometrics, 126, 1675–1694.

28. Watermeyer, R., Derrick, G. E., & Borras Batalla, M. (2022). Affective auditing: The emotional weight of the Research Excellence Framework. Research Evaluation, 31(4), 498–506.

29. Wróblewska, M. N. (2021). Research impact evaluation and academic discourse. Humanities and Social Sciences Communications, 8, 58.

30. Yandamuri, U. S. (2022). Big Data Pipelines for Cross-Domain Decision Support: A Cloud-Centric Approach. International Journal of Scientific Research and Modern Technology, 1(12), 227-237.

31. Nguyen, H. T. L., Adi Badiozaman, I. F. bt, & Ling, V. M. (2023). Agency in academic promotion: Self-oriented and socially-oriented strategies among Australian academics. Studies in Higher Education, 48(11), 1609–1623.

32. Ross-Hellauer, T., Klebel, T., Knoth, P., & Pontika, N. (2023). Value dissonance in research(er) assessment: Individual and perceived institutional priorities in review, promotion, and tenure. Science and Public Policy, 51(3), 337–351.

33. Reddy, V. A. R. (2022). Designing Fault-Tolerant Data Ingestion Pipelines for High-Volume Healthcare Transactions. Frontiers in Health Informatics, 11, 861-889.

Additional Files

Published

2024-02-20

How to Cite

How Evaluation Systems Quietly Steer Academic Trajectories. (2024). Journal of Artificial Intelligence and Big Data Disciplines, 2(01). https://jaibdd.org/index.php/jaibddjournals/article/view/52