2611005613
  • Open Access
  • Article

CLOF: A Coupled Framework for Quantifying Research Impacts via A Double Iterative Power Method

  • Junyuan Fang 1,   
  • Zhihao Yu 1,   
  • Xiangyu Cai 2,   
  • Hao Wang 1,* and 
  • Dapeng Oliver Wu 1

Received: 05 February 2026 | Revised: 09 November 2026 | Accepted: 09 November 2026 | Published: 18 November 2026

Abstract

Research impact quantification plays a crucial role in academic assessment. Conventional citation-based metrics have several limitations in fair and comprehensive research evaluation. They often fail to recognize foundational work that receives limited early attention. They may also overlook sustained influence over time, differences across research fields, citation quality reflected by citation contexts and the expertise of citing authors, and variations in author contributions. We incorporate these aspects at the paper level through four factors: originality-oriented downstream influence, long-term influence, field-specific ranking, and citation quality. At the researcher level, we quantify credit according to author order. Based on these, we propose CLOF, a unified metric framework that quantifies the impacts of papers and researchers in an interdependent and iterative manner. To reduce reliance on manually specified weighting schemes, we employ multiple large language model (LLM)-based paper scorers. Their outputs are aggregated using an α-trimmed procedure to generate robust global signals for learning the combination weights. These learned weights further guide the coupled iterative updates of paper and researcher scores via a Double Iterative Power (DIP) method with theoretical convergence guarantees. Extensive experiments on academic datasets show that CLOF uncovers influence patterns across papers and researchers that are not captured by existing impact metrics.

References 

  • 1.

    Kostoff, R.N. Research Impact Quantification. R D Manag. 1994, 24, 207–218. https://doi.org/10.1111/j.1467-9310.1994.tb00874.x.

  • 2.

    Lane, J. Let’s Make Science Metrics More Scientific. Nature 2010, 464, 488–489. https://doi.org/10.1038/464488a.

  • 3.

    Mustafa, G.; Rauf, A.; Ahmed, B.; et al. Comprehensive Evaluation of Publication and Citation Metrics for Quantifying Scholarly Influence. IEEE Access 2023, 11, 65759–65774. https://doi.org/10.1109/access.2023.3290917.

  • 4.

    Klebel, T.; Traag, V.; Grypari, I.; et al. The Academic Impact of Open Science: A Scoping Review. R. Soc. Open Sci. 2025, 12, 241248. https://doi.org/10.1098/rsos.241248.

  • 5.

    Calò, L.N. Impact Metrics and Science Evaluation. Rev. Peru. Med. Exp. Salud Publica 2022, 39, 236–240. https://doi.org/10.17843/rpmesp.2022.392.11171.

  • 6.

    Wei, Q.; Mingkun, W.; Danyang, L.; et al. Identification and Portraits of Open Access Journals Based on Open Impact Metrics Extracted from Social Activities. J. Sch. Publ. 2023, 54, 597–623. https://doi.org/10.3138/jsp-2022-0081.

  • 7.

    Ou, G.; Zhao, K.; Zuo, R.; et al. Effects of Research Funding on the Academic Impact and Societal Visibility of Scientific Research. J. Inf. 2024, 18, 101592. https://doi.org/10.1016/j.joi.2024.101592.

  • 8.

    Faghri, A.; Bergman, T.L. Ranking Academic Institutions Based on the Productivity, Impact, and Quality of Institutional Scholars. J. Data Inf. Sci. 2024, 9, 116–154. https://doi.org/10.2478/jdis-2024-0017.

  • 9.

    Wiechetek, Ł.; Pastuszak, Z. Academic Social Networks Metrics: An Effective Indicator for University Performance? Scientometrics 2022, 127, 1381–1401. https://doi.org/10.1007/s11192-021-04258-6.

  • 10.

    Leal Filho, W.; Viera Trevisan, L.; Wahaj, Z.; et al. University Rankings and Sustainable Development: The State of the Art. Int. J. Sustain. High. Educ. 2025, 26, 1615–1636. https://doi.org/10.1108/ijshe-11-2023-0530.

  • 11.

    Rushforth, A.; De Rijcke, S. Practicing Responsible Research Assessment: Qualitative Study of Faculty Hiring, Promotion, and Tenure Assessments in the United States. Res. Eval. 2024, 33, rvae007. https://doi.org/10.1093/reseval/rvae007.

  • 12.

    Agarwal, A.; Durairajanayagam, D.; Tatagari, S.; et al. Bibliometrics: Tracking Research Impact by Selecting the Appropriate Metrics. Asian J. Androl. 2016, 18, 296–309. https://doi.org/10.4103/1008-682x.171582.

  • 13.

    Lyu, P.H.; Liu, X.; Yao, T. A Bibliometric Analysis of Literature on Bibliometrics in Recent Half-Century. J. Inf. Sci. 2023, 52, 324–344. https://doi.org/10.1177/01655515231191233.

  • 14.

    Ninkov, A.; Frank, J.R.; Maggio, L.A. Bibliometrics: Methods for Studying Academic Publishing. Perspect. Med. Educ. 2021, 11, 173–176. https://doi.org/10.1007/s40037-021-00695-4.

  • 15.

    Garfield, E. Citation Indexes for Science. Science 1955, 122, 108–111. https://doi.org/10.1126/science.122.3159.108.

  • 16.

    Hirsch, J.E. An Index to Quantify an Individual’s Scientific Research Output. Proc. Natl. Acad. Sci. USA 2005, 102, 16569–16572. https://doi.org/10.1073/pnas.0507655102.

  • 17.

    Manghi, P.; Mannocci, A.; Osborne, F.; et al. New Trends in Scientific Knowledge Graphs and Research Impact Assessment. Quant. Sci. Stud. 2021, 2, 1296–1300. https://doi.org/10.1162/qss_e_00160.

  • 18.

    Życzkowski, K. Citation Graph, Weighted Impact Factors and Performance Indices. Scientometrics 2010, 85, 301–315. https://doi.org/10.1007/s11192-010-0208-6.

  • 19.

    Giatsidis, C.; Nikolentzos, G.; Zhang, C.; et al. Rooted Citation Graphs Density Metrics for Research Papers Influence Evaluation. J. Inf. 2019, 13, 757–768. https://doi.org/10.1016/j.joi.2019.03.006.

  • 20.

    Page, L.M.; Brin, S.; Motwani, R.; et al. The PageRank Citation Ranking: Bringing Order to the Web; Stanford InfoLab: Stanford, CA, USA, 1999.

  • 21.

    Costas, R.; Bordons, M. The H-Index: Advantages, Limitations and Its Relation with Other Bibliometric Indicators at the Micro Level. J. Inf. 2007, 1, 193–203. https://doi.org/10.1016/j.joi.2007.02.001.

  • 22.

    Schreiber, M. Self-Citation Corrections for the Hirsch Index. Europhys. Lett. EPL 2007, 78, 30002. https://doi.org/10.1209/0295-5075/78/30002.

  • 23.

    Maabreh, M.; Alsmadi, I.M. A Survey of Impact and Citation Indices: Limitations and Issues. Int. J. Adv. Sci. Technol. 2012, 40, 35–54.

  • 24.

    Haustein, S.; Larivière, V. The Use of Bibliometrics for Assessing Research: Possibilities, Limitations and Adverse Effects. In Incentives and Performance: Governance of Research Organizations; Springer: Cham, Switzerland, 2015; pp. 121–139. https://doi.org/10.1007/978-3-319-09785-5-8.

  • 25.

    Mesiar, R.; Gagolewski, M. H-Index and Other Sugeno Integrals: Some Defects and Their Compensation. IEEE Trans. Fuzzy Syst. 2016, 24, 1668–1672. https://doi.org/10.1109/tfuzz.2016.2516579.

  • 26.

    Manoj Kumar, L.; George, R.J.; Anisha, P.S. Bibliometric Analysis for Medical Research. Indian J. Psychol. Med. 2023, 45, 277–282. https://doi.org/10.1177/02537176221103617.

  • 27.

    Tomaszewski, R. Visibility, Impact, and Applications of Bibliometric Software Tools through Citation Analysis. Scientometrics 2023, 128, 4007–4028. https://doi.org/10.1007/s11192-023-04725-2.

  • 28.

    Hassan, W.; Duarte, A.E. Bibliometric Analysis: A Few Suggestions. Curr. Probl. Cardiol. 2024, 49, 102640. https://doi.org/10.1016/j.cpcardiol.2024.102640.

  • 29.

    Matorevhu, A. Bibliometrics: Application Opportunities and Limitations. In Bibliometrics - An Essential Methodological Tool for Research Projects; IntechOpen: London, UK, 2024. https://doi.org/10.5772/intechopen.1005292.

  • 30.

    Alter, N.; Daiem, M.; Pontell, M.E.; et al. Limitations of Academic Bibliometric Indices: The Need for More Comprehensive Metrics. Ann. Plast. Surg. 2025, 95, 603–606. https://doi.org/10.1097/sap.0000000000004484.

  • 31.

    Egghe, L. Theory and Practise of the G-Index. Scientometrics 2006, 69, 131–152. https://doi.org/10.1007/s11192-006-0144-7.

  • 32.

    Burrell, Q.L. On the H-Index, the Size of the Hirsch Core and Jin’s a-Index. J. Inf. 2007, 1, 170–177. https://doi.org/10.1016/j.joi.2007.01.003.

  • 33.

    Khan, N.R.; Thompson, C.J.; Taylor, D.R.; et al. Part II: Should the H-Index Be Modified? An Analysis of the M-Quotient, Contemporary H-Index, Authorship Value, and Impact Factor. World Neurosurg. 2013, 80, 766–774. https://doi.org/10.1016/j.wneu.2013.07.011.

  • 34.

    Ibrahim, N.; Habacha Chaibi, A.; Ben Ahmed, M. New Scientometric Indicator for the Qualitative Evaluation of Scientific Production. New Libr. World 2015, 116, 661–676. https://doi.org/10.1108/nlw-01-2015-0002.

  • 35.

    Farooq, M.; Khan, H.U.; Iqbal, S.; et al. DS-Index: Ranking Authors Distinctively in an Academic Network. IEEE Access 2017, 5, 19588–19596. https://doi.org/10.1109/access.2017.2744798.

  • 36.

    Yang, A.J.; Hu, H.; Zhao, Y.; et al. From Consolidation to Disruption: A Novel Way to Measure the Impact of Scientists and Identify Laureates. Inf. Process. Manag. 2023, 60, 103420. https://doi.org/10.1016/j.ipm.2023.103420.

  • 37.

    Zhao, W.; Korobskiy, D.; Chacko, G. Delayed Recognition: A Co-Citation Perspective. Front. Res. Metrics Anal. 2021, 5, 577131. https://doi.org/10.3389/frma.2020.577131.

  • 38.

    Albert, R.; Barabási, A.L. Statistical Mechanics of Complex Networks. Rev. Mod. Phys. 2002, 74, 47. https://doi.org/10.1103/revmodphys.74.47-97.

  • 39.

    Bloch, F.; Jackson, M.O.; Tebaldi, P. Centrality Measures in Networks. Soc. Choice Welf. 2023, 61, 413–453. https://doi.org/10.1007/s00355-023-01456-4.

  • 40.

    Ugurlu, O. Comparative Analysis of Centrality Measures for Identifying Critical Nodes in Complex Networks. J. Comput. Sci. 2022, 62, 101738. https://doi.org/10.1016/j.jocs.2022.101738.

  • 41.

    Ding, Y.; Yan, E.; Frazho, A.; et al. PageRank for Ranking Authors in Co-Citation Networks. J. Am. Soc. Inf. Sci. Technol. 2009, 60, 2229–2243. https://doi.org/10.1002/asi.21171.

  • 42.

    Fiala, D. Time-Aware PageRank for Bibliographic Networks. J. Inf. 2012, 6, 370–388. https://doi.org/10.1016/j.joi.2012.02.002.

  • 43.

    Kleinberg, J.M. Authoritative Sources in a Hyperlinked Environment. J. ACM 1999, 46, 604–632. https://doi.org/10.1145/324133.324140.

  • 44.

    Bergstrom, C. Eigenfactor: Measuring the Value and Prestige of Scholarly Journals. Coll. Res. Libr. News 2007, 68, 314–316. https://doi.org/10.5860/crln.68.5.7804.

  • 45.

    Franceschet, M.; Colavizza, G. Quantifying the Higher-Order Influence of Scientific Publications. Scientometrics 2020, 125, 951–963. https://doi.org/10.1007/s11192-020-03580-9.

  • 46.

    Wankhade, M.; Rao, A.C.S.; Kulkarni, C. A Survey on Sentiment Analysis Methods, Applications, and Challenges. Artif. Intell. Rev. 2022, 55, 5731–5780. https://doi.org/10.1007/s10462-022-10144-1.

  • 47.

    Brin, S.; Page, L. The Anatomy of a Large-Scale Hypertextual Web Search Engine. Comput. Netw. ISDN Syst. 1998, 30, 107–117. https://doi.org/10.1016/s0169-7552(98)00110-x.

  • 48.

    Jachymski, J.; Józwik, I.; Terepeta, M. The Banach Fixed Point Theorem: Selected Topics from Its Hundred-Year History. Rev. Real Acad. Cienc. Exactas Fis. Nat. Ser. A-Mat. 2024, 118, 140. https://doi.org/10.1007/s13398-024-01636-6.

  • 49.

    Wan, H.; Zhang, Y.; Zhang, J.; et al. AMiner: Search and Mining of Academic Social Networks. Data Intell. 2019, 1, 58–76. https://doi.org/10.1162/dint_a_00006.

  • 50.

    Beltagy, I.; Lo, K.; Cohan, A. SciBERT: A Pretrained Language Model for Scientific Text. arXiv 2019, arXiv:1903.10676.

  • 51.

    Sanh, V.; Debut, L.; Chaumond, J.; et al. DistilBERT, a Distilled Version of BERT: Smaller, Faster, Cheaper and Lighter. arXiv 2019, arXiv:1910.01108. http://arxiv.org/abs/1910.01108v4.

  • 52.

    Jiang, A.Q.; Sablayrolles, A.; Roux, A.; et al. Mixtral of Experts. arXiv 2024, arXiv:2401.04088.

  • 53.

    ScholarGPS: Quantitative Rankings and Profiles of Scholars and Institutions. Available online: https://www.scholargps.com (accessed on 23 July 2025).

Share this article:
How to Cite
Fang, J.; Yu, Z.; Cai, X.; Wang, H.; Wu, D. O. CLOF: A Coupled Framework for Quantifying Research Impacts via A Double Iterative Power Method. Transactions on Artificial Intelligence 2026, 2 (1), 245–265. https://doi.org/10.53941/tai.2026.100016.
RIS
BibTex
Copyright & License
article copyright Image
Copyright (c) 2026 by the authors.
Article Metrics
65
Article Views
0
Citations