There is an open source ranking tool for large language models (LLMs) behind the chatbots. The Chatbot Arena Leaderboard is built and maintained by research group LMSYS and the University of California, Berkeley’s Sky Computing Lab. The Chatbot Arena will allow you to prompt two models at once to easily compare their responses. Another leaderboard ranks LLMs based on how much electric power they use per query.
Before you decide to use any of the above tools, consider the weaknesses of artificial intelligence and the ways in which the bot may negatively impact your values.
Always consult with your advisors and instructors before using AI in your academic work. Many publishers also have policies around the use of AI in the work they accept for publication.
his flowchart was designed with ChatGPT in mind, but provides a helpful model for working with any generative AI.
Using ChatGPT with Caution
For detailed discussion on the weaknesses and pitfalls of AI, see https://writingcenter.unc.edu/tips-and-tools/generative-ai-in-academic-writing/
For more information on environmental costs of AI, see:
Chen, Sophia. "How much energy will AI really consume? The good, the bad and the unknown." Nature 639, no. 8053 (2025): 22-24.
"Using ChatGPT with Caution" and "Prompt Examples and their Functions" are adapted from the AI Literacy Module developed by the Rush University's Center for Teaching Excellence and Innovation. They are used under a CC BY-NC-SA License.
"These systems [artificial intelligence tools] use mathematical probabilities to guess the best response, not a strict set of rules defined by human engineers. So they make a certain number of mistakes. 'Despite our best efforts, they will always hallucinate,' said Amr Awadallah, the chief executive of Vectara, a start-up that builds A.I. tools for businesses, and a former Google executive. 'That will never go away.'"
Cade Metz and Karen Weise, “A.I. Is Getting More Powerful, but Its Hallucinations Are Getting Worse,” The New York Times, May 5, 2025, sec. Technology, https://www.nytimes.com/2025/05/05/technology/ai-hallucinations-chatgpt-google.html.
"Chatbots make things up constantly. They’re also designed to be friendly and agreeable so you’ll spend more time using them. The combination sometimes results in obsequious nonsense, like our Washington Post colleague who found OpenAI’s ChatGPT invented passages from her own published columns and fabricated why that was happening." Hallucinations are a part of how these programs are trained to keep you chatting and using them. They will support your ideas to a fault.
Ovide, Shira, and Heather Kelly. “6 Tips to Avoid Using AI Chatbots All Wrong.” The Washington Post, June 20, 2025, sec. Analysis. https://www.washingtonpost.com/technology/2025/06/20/ai-chatbot-mistakes-users/.
Ways in which using an artificial intelligence might invade your privacy or those of who you're researching/asking about:
A good rule of thumb: Before confiding in chatbots, imagine how you’d feel if the information you’re typing were subpoenaed or leaked publicly.
Ovide, Shira, and Heather Kelly. “6 Tips to Avoid Using AI Chatbots All Wrong.” The Washington Post, June 20, 2025, sec. Analysis. https://www.washingtonpost.com/technology/2025/06/20/ai-chatbot-mistakes-users/.
Singer, Natasha SingerNatasha, Who Covers Tech in Schools, reported from New York, and San Diego. “Welcome to Campus. Here’s Your ChatGPT.” The New York Times, June 7, 2025, sec. Technology. https://www.nytimes.com/2025/06/07/technology/chatgpt-openai-colleges.html.