Despite ChatGPT’s popularity, its issues with accuracy have been well-documented since its inception. OpenAI admits that the free version of the chatbot has “limited knowledge of world events after 2021,” and is prone to filling in replies with incorrect data if there is not enough information available on a subject.
However, OpenAI recently announced that ChatGPT Plus subscribers, who have access to the GPT-4 model, will be able to search the web for up-to-date information.
Subscribers will now be able to go beyond the confines of pre-loaded data and search the web for real-time information. Need the latest news, facts, or updates? You got it covered! What's even better is that you can pose multiple queries in a continuous conversational format, allowing you to delve deeper into any topic right within your browser. Conversations are automatically named and saved in the sidebar, making it easy for you to manage, rename, or delete them. Plus, you even have the ability to "hide" specific chats if you prefer a clutter-free interface. With ChatGPT Plus and its web search capability, you can explore and discover an entirely new level of interactive information exchange.
At the same time, the information it possesses may not be sufficient, which affects various areas. For example, the University of Minnesota Law School had ChatGPT take four exams alongside real students. The chatbot ended up with a C+ grade. According to Professor John Choi (Harvard Law School's The Practice, 2023), ChatGPT could cite laws and accurately describe cases in its essays, but it couldn't "spot issues" and provide deep reasoning or analysis. While Gen AI demonstrates proficiency in common statistical methods, it may fall short when confronted with advanced or highly specialized statistical techniques. This limitation raises questions about the adaptability of Gen AI to diverse and specialized domains within data science. Understanding the extent of its statistical acumen is crucial for accurately gauging its applicability across various industries.