Tabriz University of Medical Sciences Advanced Pharmaceutical Bulletin 2228-5881 14 1 2024 03 07 Diagnosis Unreliability of ChatGPT for Journal Evaluation 1 4 10.34172/apb.2024.020 EN Mehdi Dadkhah https://orcid.org/0000-0001-7964-4762 Marilyn H Oermann https://orcid.org/0000-0002-4534-8962 Mihály Hegedüs https://orcid.org/0000-0001-8064-0208 Raghu Raman Lóránt Dénes Dávid https://orcid.org/0000-0001-7880-9860 EDITORIAL 10.34172/apb.2024.020 2023 09 21 2023 10 10 Purpose: Academic and other researchers have limited tools with which to address the current proliferation of predatory and hijacked journals. These journals can have negative effects on science, research funding, and the dissemination of information. As most predatory and hijacked journals are not error free, this study used ChatGPT, an artificial intelligence (AI) technology tool, to conduct an evaluation of journal quality. Methods: Predatory and hijacked journals were analyzed for reliability using ChatGPT, and the reliability of result have been discussed. Results: It shows that ChatGPT is an unreliable tool for journal quality evaluation for both hijacked and predatory journals. Conclusion: To show how to address this gap, an early trial version of Journal Checker Chatbot has been developed and is discussed as an alternative chatbot that can assist researchers in detecting hijacked journals.