Advanced pharmaceutical bulletin. 14(4):729-736.
doi: 10.34172/apb.43763
Editorial
Unmasking Greenwashing: Mapping Hijacked Medicine Journals to the Sustainable Development Goals
Mihály Hegedűs Conceptualization, Data curation, Investigation, Methodology, Writing – original draft, 1 
Mehdi Dadkhah Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Project administration, Software, Validation, Writing – original draft, 2, * 
Lóránt Dénes Dávid Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – review & editing, 3, 4, 5, 6 
Author information:
1Tomori Pál College, Chamber of Hungarian Auditors, Budapest, Hungary.
2Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Amritapuri, Kerala, India.
3John von Neumann University, Faculty of Economics and Business, Department of Tourism and Hospitality, HU-6000 Kecskemét, Hungary.
4Hungarian University of Agriculture and Life Sciences (MATE), Institute of Rural Development and Sustainable Economy, Department of Sustainable Tourism, HU-2100 Gödöllő, Hungary.
5Eötvös Loránd University, Faculty of Social Sciences, Savaria University Centre, Savaria Department of Business Economics, HU-9700 Szombathely, Hungary.
6Széchenyi István University, HU-9026 Győr, Hungary.
Abstract
Purpose:
Hijacked journals are journals managed by cybercriminals that mimic the original journal and publish manuscripts without peer review, charging a fee to the author. Although there is literature on hijacked journals, there is a gap in the content of published papers in the hijacked journals. This study aims to analyze the content of published papers in hijacked journals to assess their alignment with various Sustainable Development Goals (SDGs).
Methods:
About 21 medicine journals have been investigated and about 3300 published manuscripts in them analyzed in terms of SDGs using the text-based analyzing method.
Results:
The findings indicated that published manuscripts fit in the categories of SDG 01, SDG 03, SDG 11, and SDG 16 where SDG-03 is most dominant.
Conclusion:
The awareness about the problem of hijacked journals is critical, especially for developing countries, to eliminate the negative effects of these journals. It is the first research that discusses the negative effect of hijacked journals by considering SDGs and sheds light on the phenomenon.
Keywords: Hijacked journals, Medicine, Predatory journals, Publication ethics, Scientific ranking, Sustainable development goals, Circular economy
Copyright and License Information
©2024 The Author (s).
This is an Open Access article distributed under the terms of the Creative Commons Attribution (CC BY), which permits unrestricted use, distribution, and reproduction in any medium, as long as the original authors and source are cited. No permission is required from the authors or the publishers.
Funding Statement
This work was supported by the Flagship Research Groups Programme of the Hungarian University of Agriculture and Life Sciences (MATE).
Introduction
Reputable academic journals, for example, journals indexed in Web of ScienceTM (WoS) Journal Citation Report and Scopus, are faced with a high volume of submissions and limited space for publishing papers. As a result, they only accept the most qualified papers and reject many submitted manuscripts.1 Cyber fraudsters, referred to in this paper as hijackers, found this situation an opportunity to launch new types of fraud by developing fake websites for indexed journals. Typically, hijackers search for indexed journals that do not have a website (print-only journals), or their websites have a low ranking in the search engines, so it is difficult to find the journal’s website. Hijackers then develop a website for the target journal with good search engine optimization (SEO) and claim that this hijacked website is the original website of the indexed journal. When researchers search for the name of the reputable, indexed journal in various search engines, they find the fake website. This paper refers to these as hijacked journals. In other words, hijacked journals are the second fake website(s) for original authenticated journals that have been created and managed by hackers.2 This process has been called journal hijacking.3,4
Researchers searching for reputable journals may search the ISSN in WoS to ensure the journal is indexed. However, this will not be enough to deal with hijacked journals because they use the exact description of the original journal, including its title, ISSN, and other information about the journal. If a bibliographic database such as WoS provides a link to the original website of the journal, the hijacking attempt will likely fail. In 2015, however, Dadkhah detected the URLs of some hijacked journals in the WoS database with the journal description. Thus, for these journals, researchers searching for a journal would be directed to the hijacked version.5 Dadkhah proposed a method for detecting this new kind of advanced journal hijacking. Dadkhah found that hijackers monitor journal websites, and when a domain of a journal website has expired, they register the domain and gain control of that ceased journal 5. Other names for this phenomenon include journal phishing, and cloned or robbed journals.6
Some researchers confuse predatory journals with hijacked journals and think the two are the same, but they are not. A predatory journal is a journal that does not adhere to editorial and publishing standards. Predatory journals have their name and ISSN, even though they may mimic the names of some reputable and legitimate journals.7,8 Hijacked journals, in contrast, mimic a journal with its title and ISSN to deceive researchers. These journals publish any manuscript, without peer review, and charge authors a fee to publish article.1
Sustainable Development Goals
The SDGs are a set of global goals adopted by the UN in 2015, as part of the 2030 Agenda for Sustainable Development. The SDGs are a framework for global action to end poverty, protect the planet, and ensure that all people have the opportunity to live peaceful and prosperous lives.9,10 There are 17 SDGs in total, all interconnected and interdependent. The SDGs are no poverty (SDG 1), zero hunger (SDG 2), good health and well-being (SDG 3), quality education (SDG 4), gender equality (SDG 5), clean water and sanitation (SDG 6), affordable and clean energy (SDG 7), decent work and economic growth (SDG 8), industry, innovation and infrastructure (SDG 9), reduced inequalities (SDG 10), sustainable cities and communities (SDG 11), responsible consumption and production (SDG 12), climate action (SDG 13), life below water (SDG 14), life on land (SDG 15), peace, justice, and strong institutions (SDG 16), and partnerships for the goals (SDG 17).9
The importance of the SDGs lies in their potential to address some of the most pressing challenges facing the world today. These challenges include poverty, inequality, environmental degradation, and the impacts of climate change, among others. The SDGs aim to create a more sustainable and equitable world for present and future generations by addressing these challenges. The SDGs are important for everyone, affecting all aspects of our lives and the world. Governments, businesses, civil society organizations, and individuals all have a role to play in achieving the SDGs. The SDGs also provide a common framework for countries to measure progress and hold themselves accountable for meeting their commitments. Various research groups analyze the progress of SDGs-related research in different fields based on regions.11-15
Hijacked journals and SDGs
Hijacked journals can hurt research that supports SDGs by publishing manuscripts that are related to the United Nations (UN) SDGs. Open access (OA) publishing has an impact on SDGs,16 and hijacked journals mainly mimic the OA publishing model to publish papers but without the required peer review and publishing process. Open access publishing provides access to cutting-edge knowledge (SDG 9). New research findings disseminated in OA papers can support clean energy, sustainable agriculture, and predict risks (SDG 2, 7, and 11); improve the equality of researchers across countries to science (SDG 6, and 10); provide access to transparent and accountable data (SDG 16); and can move forward all SDGs and their policy-making.16 Hijacked journals mainly mimic this OA model, and publish papers that may contribute to SDGs. These published papers are not peer reviewed and can threaten the integrity of science and disseminate error and misleading information when receiving citations from the side of research.
Abalkina found some indexed content from hijacked journals in bibliographic databases that have been indexed by mistake or penetration of bibliographic databases.17 However, this content was removed when the hijacked nature of the journal was confirmed.17 Hijacked journals claim that they are indexed in bibliographic databases but they are not indexed. The original journal is indexed and only content from the original journal. The hijacked version only mimics the original one. When researchers publish in hijacked journals (intentionally or by being deceived), the number of indexed papers for that country will decrease in these bibliographic databases. As a result, the scientific rank of that country and its universities will be negatively impacted.18 There are some ranking systems to credit universities and countries based on SDGs-related research,19 so hijacked journals will negatively impact the SDGs ranking of universities.
The published papers in hijacked journals will not be indexed (or will be removed upon detection), and most hijackers close their websites with the hijacked journals after some time,20 thus losing these potential scientific contributions to SDGs. Hijacked journals are a risk to the integrity of science, as they publish non-peer-reviewed content.1 Others may cite this information as the articles appear to be peer-reviewed academic papers. This can lead to the propagation of pseudo-science and errors from published SDGs-related papers in hijacked journals to other research that supports SDGs in legitimate journals.
There is no study to examine how much the published papers in hijacked journals are related to SDGs. Indeed, most of the published papers on the topic of hijacked journals introduce the problem of these journals and try to provide information for the detection of them. Current research aims to examine the content of published papers in hijacked journals to assess their alignment with various SDGs.
Literature review
The search in bibliographic databases (both WoS and Scopus) did not return any publications regarding hijacked journals and sustainable development (as of March 2024). This is a gap in this regard, and it reveals the importance of discussing hijacked journals concerning SDGs. A search on the term “hijacked journal*” in Scopus by article titles returned 23 documents. A search in Google Scholar revealed some additional publications. Most studies in this area were done by a few researchers, including Dadkhah, Maliszewski, Borchardt, Abalkina, Jalalian, Davarpanah Jazi, Moussa, etc. Most publications focus on increasing awareness about the phenomenon with limited discussion on the negative impact of hijacked journals or methods for detecting hijacked journals.
Although there are limited publications on hijacked journals, the extent of the potential impact is not limited: hijacked journals can negatively affect the scientific rank of more than 71% of countries worldwide.18 The analysis of the marketing field indicates that published papers in questionable journals could receive citations from SSCI-indexed marketing journals.21 The problem is even more critical when the content of hijacked journals, which are not peer-reviewed, is indexed in reputable bibliographic databases (by mistake or deception by hijackers).5,22
Methodology
The data for the study are the published papers in the hijacked version of medicine journals as introduced in research by Dadkhah and his colleagues.23 These data are based on known hijacked journals as listed in Retraction Watch Hijacked Journal Checker on 15 Jan 2023 16 and alignment of them based on Scimago’s main subject area (https://www.scimagojr.com) on medicine category. Twenty-one hijacked medical journals have been identified, and their published papers have been downloaded as soon as possible without any filter on the date of publication. This period has been selected because most hijacked journals are only available for a short time; once the expected income is received, the hijacker may close the website to prevent detection of their identity or maybe abandon it.
Collecting these data, the title and abstract of the downloaded articles were extracted to shape the dataset. Different methods exist to identify papers related to each SDGs, such as Elsevier, SIRIS, Aurora, etc.24 Elsevier published a report entitled “The power of data to advance SDGs” in 2020. This report discussed SDG-related publications from 2015 through 2019 across various fields.25 The Elsevier method identified SDG publications based on Boolean search queries to find SDG-related keywords in the papers. The source of data was Scopus.24,26 The SIRIS also checks by using a set of terms related to each SDG by the UN, but it also searches for keywords that semantically may be related to the main SDG terms. It uses a machine learning model based on neural networks to conduct this process.24,27 Aurora also uses Boolean search strings based on terms in the UN policy documents and Scopus data, but it is not fully developed for global analysis. The future version of Aurora will include new terms from updated UN documents, synonyms, keywords, combinations, and terms retrieved through survey data.28,29
As there is no best method to identify texts that are related to each SDG,12,30 the current study used all three methods, including Elsevier, SIRIS, and Aurora, to map articles in the hijacked journals to the SDGs. These methods help to understand which publications contribute to which SDGs. These methods have been implemented by using the R programming language. The appendix shows the related R libraries used for the methodology section.
Findings
The list of used medicine hijacked journals is shown in Table 1.23 Some hijacked journals were inactivated, and some did not provide free access to the published papers. Finally, A dataset of 3384 papers from hijacked journals was compiled. Table 1 provides the names of the hijacked versions of the journals, and the number of downloaded articles.
Table 1.
The list of used medicine hijacked journals
23
The published papers in the hijacked version of medicine journals have been mapped to SDGs using the three methods (Aurora, Elsevier, and SIRIS). The results have been illustrated in Figures 1-3. The 17 sustainable goals are represented using these acronyms in the figures: SDG 1 (No poverty in any form), SDG 2 (Food security and sustainable agriculture), SDG 3 (Well-being for all ages), SDG 4 (Quality of education and lifetime learning), SDG 5 (Gender equality), SDG 6 (Access to water), SDG 7 (Access to sustainable energy), SDG 8 (Sustainable economic growth), SDG 9 (Sustainable infrastructure, industrialization, and innovation), SDG 10 (Reduction of inequality), SDG 11 (Sustainable cities), SDG 12 (Sustainable production), SDG 13 (Combating climate change), SDG 14 (Sustainably consideration for oceans, seas, and life below water), SDG 15 (Sustainable forests and land), SDG 16 (Peaceful societies), and SDG 17 (Global partnership to reach sustainable development). The SDGs’ descriptions are based on Gigliotti and colleagues’ research.31
Figure 1.
The published papers in hijacked journals and their map to SDGs (using Aurora)
Figure 1.
The published papers in hijacked journals and their map to SDGs (using Aurora)
Figure 2.
The published papers in hijacked journals and their map to SDGs (using Elsevier)
Figure 2.
The published papers in hijacked journals and their map to SDGs (using Elsevier)
Figure 3.
The published papers in hijacked journals and their map to SDGs (using SIRIS)
Figure 3.
The published papers in hijacked journals and their map to SDGs (using SIRIS)
Table 2 provides the top detected SDGs based on each method. At least two methods identified SDG 01, SDG 03, SDG 11, and SDG 16 as the top-mentioned SDGs in the published papers. SDG 02, SDG 04, SDG 05, SDG 10 and SDG 13 have been identified as top mentioned by one method. This suggests that the hijacked version of medicine journals impacts sustainable development-related research by publishing studies that fit in “good health and well-being”, no poverty, “sustainable cities and communities”, and “peace, justice and strong institutions” based on good evidence from at least two methods of SDG detection. Also, they influence the SDGs’ research by publishing research that fits with in zero hunger, quality education, gender equality, reduced inequality, and climate action based on evidence from an SDG detection method. This means that the hijacked versions of medicine journals could hurt the scientific ranks of research centers and universities, especially on SDG 01, SDG 03, SDG 11, and SDG 16. There are also risks of propagation of errors and pseudoscience related to the mentioned SDGs because hijacked journals do not conduct peer review. Lack of peer review could hurt the progress of SDGs and pose risks, especially in health-related goals.
Table 2.
The top identified SDGs in each method
Aurora
|
Elsevier
|
SIRIS
|
SDG-03 |
SDG-03 |
SDG-03 |
SDG-01 |
SDG-01 |
SDG-10 |
SDG-13 |
SDG-05 |
SDG-04 |
SDG-11 |
SDG-11 |
SDG-11 |
SDG-02 |
SDG-16 |
SDG-16 |
Figures 4-6 illustrate the papers’ most frequently used SDG terms by considering each method. These keywords indicate how published papers in the hijacked journals are related to SDG science. The papers discuss COVID-19, diabetes, obesity, hepatitis, vaccine, healthcare quality, etc.
Figure 4.
The word cloud of SDGs terms in the papers (using Aurora)
Figure 4.
The word cloud of SDGs terms in the papers (using Aurora)
Figure 5.
The word cloud of SDGs terms in the papers (using Elsevier)
Figure 5.
The word cloud of SDGs terms in the papers (using Elsevier)
Figure 6.
The word cloud of SDGs terms in the papers (using SIRIS)
Figure 6.
The word cloud of SDGs terms in the papers (using SIRIS)
Discussion
The findings indicate that the hijacked version of the medicine journal publishes manuscripts that fit SDGs categories and wastes time and effort from research centers and universities for publishing papers in non-authenticated journals. This highlights the harm hijacked journals can impose on science, researchers, universities, and countries. The published papers in the hijacked journals will not impact science positively and may affect the research integrity reported as these journals do not have peer review and are managed by cybercriminals.
The analysis (Figure 1-6) indicates that hijacked versions of medicine journals impact SDG-related research, especially on SDG 01, SDG 03, SDG 11, and SDG 16. The analysis indicates the top supported SDGs in the hijacked version of medicine journals is SDG-03 (Ensure healthy lives and promote well-being for all at all ages). This confirms that hijacked versions of medicine journals usually respect the main original journals’ aim and scope. Dadkhah et al.’s analysis also corroborated the finding that hijacked versions of medical journals often align with the original journals’ purpose and scope.23 However, some of the published papers may be out of the scope of the original journals, as hijackers try to publish papers in any field in the hijacked version to increase their income. As these papers will not be indexed in bibliographic databases, the effort of researchers will be wasted, and parts of sustainable development-related research will be lost. In sequence, the SDGs ranking of related institutions will be negatively impacted. While the OA model supports the progress of SDGs by providing access to research findings, hijacked journals create a barrier for SDGs because hijacked journals are not indexed in bibliographic databases such as WoS and Scopus.
Most of the victims of hijacked journals come from India, Indonesia, Nigeria, Ethiopia, the Philippines, Thailand, and Iraq.23 Sustainable development is key for all of these countries, and hijacked journals can harm these countries critically. These countries also have limited GDP per capita, and the funds going to hijacked journals can negatively impact their sustainable development.
Some of the victim universities are credible and ranked. Some have good rankings in the QS, nirf.org, etc.,23 suggesting that the problem of hijacked journals is not limited to low-ranking universities. Credible universities shape most of the victims. This shows the complexity of detecting hijacked journals and highlights the need for a national and international plan to deal with this problem.
Conclusion
The current study explored the potential repercussions of hijacked journals on sustainable development research. The results indicate that hijacked journals can waste the research budgets of universities and research centers and might disseminate research with errors. Hijacked journals negatively impact the development of science in an area. It is important that research centers and universities have to plan for the education of researchers and develop related tools to detect hijacked journals. The research published in hijacked medicine journals may be key for sustainable development, so it is important to have policies and guidelines to prevent the establishment of hijacked journals.
Appendix
For this research, the R language32 and its packages have been used.33-43
AI Usage
The AI tools have been used to improve readability in some parts of paper. The other usage of AI tools has been declared in methodology section.
Limitations and future research
The current research only inspected the hijacked version of medicine journals as the case study, and the results are limited to them. Future research should analyze hijacked journals in other fields. The results of this study are based on analysis of textual data, and it may contain tolerance. In data science analysis, tolerance is usual, especially when data are unstructured and dirty.
Competing Interests
None declared.
Ethical Approval
Not applicable.
Acknowledgements
Authors would like to thank the Flagship Research Groups Programme of the Hungarian University of Agriculture and Life Sciences (MATE).
References
- Dadkhah M, Rahimnia F, Darbyshire P, Borchardt G. Ten (Bad) reasons researchers publish their papers in hijacked journals. J Clin Nurs 2021; 30(19-20):e60-3. doi: 10.1111/jocn.15947 [Crossref] [ Google Scholar]
- Dadkhah M, Hosseini Seno SA, Borchardt G. Current and potential cyber-attacks on medical journals; guidelines for improving security. Eur J Intern Med 2017; 38:25-9. doi: 10.1016/j.ejim.2016.11.014 [Crossref] [ Google Scholar]
- Jalalian M. Hijacked journals are attacking the reliability and validity of medical research. Electron Physician 2014; 6(4):925-6. doi: 10.14661/2014.925-926 [Crossref] [ Google Scholar]
- Memon AR. Hijacked journals: a challenge unaddressed to the developing world. J Pak Med Assoc 2019; 69(10):1413-5. [ Google Scholar]
- Bohannon J. How to hijack a journal. Science 2015; 350(6263):903-5. doi: 10.1126/science.350.6263.903 [Crossref] [ Google Scholar]
- Andoohgin Shahri M, Davarpanah Jazi M, Borchardt G, Dadkhah M. Detecting hijacked journals by using classification algorithms. Sci Eng Ethics 2018; 24(2):655-68. doi: 10.1007/s11948-017-9914-2 [Crossref] [ Google Scholar]
- Beall J. Best practices for scholarly authors in the age of predatory journals. Ann R Coll Surg Engl 2016; 98(2):77-9. doi: 10.1308/rcsann.2016.0056 [Crossref] [ Google Scholar]
- Oermann MH, Wrigley J, Nicoll LH, Ledbetter LS, Carter-Templeton H, Edie AH. Integrity of databases for literature searches in nursing: avoiding predatory journals. ANS Adv Nurs Sci 2021; 44(2):102-10. doi: 10.1097/ans.0000000000000349 [Crossref] [ Google Scholar]
- Colglazier W. Sustainable development agenda: 2030. Science 2015; 349(6252):1048-50. doi: 10.1126/science.aad2333 [Crossref] [ Google Scholar]
- United Nations. Fast Facts - What is Sustainable Development? Available from: https://www.un.org/sustainabledevelopment/blog/2023/08/what-is-sustainable-development/. Published 2023. Accessed October 12, 2023.
- Achuthan K, Nair VK, Kowalski R, Ramanathan S, Raman R. Cyberbullying research—alignment to sustainable development and impact of COVID-19: bibliometrics and science mapping analysis. Comput Human Behav 2023; 140:107566. doi: 10.1016/j.chb.2022.107566 [Crossref] [ Google Scholar]
- Armitage CS, Lorenz M, Mikki S. Mapping scholarly publications related to the sustainable development goals: do independent bibliometric approaches get the same results?. Quant Sci Stud 2020; 1(3):1092-108. doi: 10.1162/qss_a_00071 [Crossref] [ Google Scholar]
- Prieto-Jiménez E, López-Catalán L, López-Catalán B, Domínguez-Fernández G. Sustainable development goals and education: a bibliometric mapping analysis. Sustainability 2021; 13(4):2126. doi: 10.3390/su13042126 [Crossref] [ Google Scholar]
- Raman R, Nair VK, Prakash V, Patwardhan A, Nedungadi P. Green-hydrogen research: what have we achieved, and where are we going? Bibliometrics analysis. Energy Rep 2022; 8:9242-60. doi: 10.1016/j.egyr.2022.07.058 [Crossref] [ Google Scholar]
- Raman R, Lathabhai H, Mandal S, Kumar C, Nedungadi P. Contribution of business research to sustainable development goals: bibliometrics and science mapping analysis. Sustainability 2023; 15(17):12982. doi: 10.3390/su151712982 [Crossref] [ Google Scholar]
- Muth LT, Salvador Lopez JM. Open access publications and their impact on sustainability development goals. In: Leal Filho W, Azul AM, Brandli L, Lange Salvia A, Wall T, eds. Industry, Innovation and Infrastructure. Cham: Springer; 2021. p. 783-97. 10.1007/978-3-319-95873-6_137.
- Abalkina A. Detecting a network of hijacked journals by its archive. Scientometrics 2021; 126(8):7123-48. doi: 10.1007/s11192-021-04056-0 [Crossref] [ Google Scholar]
- Dadkhah M, Maliszewski T. Hijacked journals-threats and challenges to countries’ scientific ranking. Int J Technol Enhanc Learn 2015; 7(3):281-8. doi: 10.1504/ijtel.2015.072819 [Crossref] [ Google Scholar]
- De la Poza E, Merello P, Barberá A, Celani A. Universities’ reporting on SDGs: using the impact rankings to model and measure their contribution to sustainability. Sustainability 2021; 13(4):2038. doi: 10.3390/su13042038 [Crossref] [ Google Scholar]
- Jalalian M. A second chance for authors of hijacked journals to publish in legitimate journals. Electron Physician 2015; 7(2):1017-8. doi: 10.14661/2015.1017-1018 [Crossref] [ Google Scholar]
- Moussa S. A “Trojan horse” in the reference lists: citations to a hijacked journal in SSCI-indexed marketing journals. J AcadLibrariansh 2021; 47(5):102388. doi: 10.1016/j.acalib.2021.102388 [Crossref] [ Google Scholar]
- Abalkina A. Do hijacked journals attract dishonest authors? Available from: https://academicintegrity.eu/conference/proceedings/2021/abalkina21.pdf.
- Dadkhah M, Hegedűs M, Nedungadi P, Raman R, Dávid LD. Unveiling the hidden menace: a topic modeling analysis of hijacked medical journals. Adv Pharm Bull 2024; 14(2):255-61. doi: 10.34172/apb.2024.029 [Crossref] [ Google Scholar]
- Rodenburg K, De Silva V, Christensen Hughes J. SDGs: a responsible research assessment tool toward impactful business research. Sustainability 2021; 13(24):14019. doi: 10.3390/su132414019 [Crossref] [ Google Scholar]
- Elsevier. The Power of Data to Advance the SDGs. 2020. Available from: https://www.elsevier.com/__data/assets/pdf_file/0004/1058179/Elsevier-SDG-Report-2020.pdf. Accessed December 22, 2022.
- Jayabalasingham B, Boverhof R, Agnew K, Klein L. Identifying research supporting the United Nations sustainable development goals. 2019. Available from: https://elsevier.digitalcommonsdata.com/datasets/87txkw7khs/1.
- Duran-Silva N, Fuster E, Massucci F, Quinquillà A. A Controlled Vocabulary Defining the Semantic Perimeter of Sustainable Development Goals (Version 1.2). Available from: https://zenodo.org/records/3567769. Published December 9, 2019.
- Purnell PJ. A comparison of different methods of identifying publications related to the United Nations Sustainable Development Goals: Case Study of SDG 13: Climate Action. ArXiv [Preprint]. 2022. Available from: https://arxiv.org/abs/2201.02006.
- Vanderfeesten M, Spielberg E, Gunes Y. Survey Data of “Mapping Research Output to the Sustainable Development Goals (SDGs)”. Available from: https://zenodo.org/records/3813230. Published May 11, 2020.
- Purnell PJ. A comparison of different methods of identifying publications related to the United Nations sustainable development goals: case study of SDG 13—climate action. Quant Sci Stud 2022; 3(4):976-1002. doi: 10.1162/qss_a_00215 [Crossref] [ Google Scholar]
- Gigliotti M, Schmidt-Traub G, Bastianoni S. The sustainable development goals. In: Fath B, ed. Encyclopedia of Ecology. 2nd ed. Oxford: Elsevier; 2019. p. 426-31. 10.1016/b978-0-12-409548-9.10986-8.
- R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2023. Available from: https://www.R-project.org/.
- Arel-Bundock V, Enevoldsen N, Yetman CJ. countrycode: an R package to convert country names and country codes. J Open Source Softw 2018; 3(28):848. doi: 10.21105/joss.00848 [Crossref] [ Google Scholar]
- Feinerer I, Hornik K, Meyer D. Text mining infrastructure in R. J Stat Softw 2008; 25:1-54. [ Google Scholar]
- Lang D, Chien G. Wordcloud2: Create Word Cloud by ‘Htmlwidget’. 2018. Available from: https://CRAN.R-project.org/package=wordcloud2.
- Ooms J. Pdftools: Text Extraction, Rendering and Converting of PDF Documents. 2023. Available from: https://CRAN.R-project.org/package=pdftools.
- Sievert C. Interactive Web-Based Data Visualization with R, Plotly, and Shiny. Chapman and Hall/CRC; 2020.
- Silge J, Robinson D. Tidytext: text mining and analysis using tidy data principles in R. J Open Source Softw 2016; 1(3):37. doi: 10.21105/joss.00037 [Crossref] [ Google Scholar]
- Tennekes M. Treemap: Treemap Visualization. 2023. Available from: https://CRAN.R-project.org/package=treemap.
- Wickham H. Ggplot2: Elegant Graphics for Data Analysis. New York: Springer-Verlag; 2016.
- Wickham H, Averick M, Bryan J, Chang W, McGowan LD, François R. Welcome to the tidyverse. J Open Source Softw 2019; 4(43):1686. doi: 10.21105/joss.01686 [Crossref] [ Google Scholar]
- Wickham H, François R, Henry L, Müller K, Vaughan D. Dplyr: A Grammar of Data Manipulation. 2023. Available from: https://CRAN.R-project.org/package=dplyr.
- Wulff DU, Meier DS. Text2sdg: Detecting UN Sustainable Development Goals in Text. 2023. Available from: https://CRAN.R-project.org/package=text2sdg.