Understanding AI Hallucinations

Artificial intelligence systems like Toby can sometimes experience what are known as “hallucinations:” falsely perceive things that aren't real. An AI hallucination occurs when an AI system generates an output or response that does not match reality. For example, an AI assistant may say that it "emailed you the report" when in fact no email was sent.

Hallucinations happen because AI systems have narrow capabilities and limited access to the real world. They operate based on the data and algorithms that have been provided to them. If an AI system's training data or algorithms are flawed or limited, the system can generate perceptions and responses that don't match reality. The system is essentially "hallucinating" due to its own limitations and disconnect from the real world.

Some common types of AI hallucinations include:

 False statements: The AI system says something factually incorrect, like stating that it performed an action when it did not. For example, saying an email was sent when one was not.

Confusing possibilities and facts: The AI system presents a possibility as if it were a proven fact. For example, guessing that a medical diagnosis is a certain condition without concrete evidence.

Seeing patterns that aren't there: The AI system detects connections or patterns in data that are not statistically valid or meaningful. This can lead the system to make inaccurate predictions or conclusions not grounded in reality.

Repetition: The AI system repeats itself or gets stuck in a loop restating the same responses, often due to limited responses in its training data. The system is essentially hallucinating variety or responsiveness that isn't reflected in what people are actually seeing and hearing from the system.

Irrelevance: The AI system's responses seem completely irrelevant or disconnected from the conversation or questions being asked. The system struggles to determine what is and is not relevant due to narrow capabilities.

The most common hallucination is the “email” hallucination where Toby indicates he will “email” you the answer to a prompt rather than producing the requested output immediately. Recognize this response for what it is and request Toby to perform the task at hand “now” rather than emailing the output. If the problem persists, please send a support ticket to [e-mail].

As we have indicated many times in the past, it is always important to fact check Toby’s output. Toby’s forte is writing, not research. The more fact-based a request, the more you need to fact check. For example, if you request Toby to write a “thank you” letter to a client, fact-checking is less important than If you request Toby to outline the cabin sizes and amenities on a particular cruise ship. Typically it is best to formulate your research, check its veracity, and then request Toby to write about the research you have presented.

Be sure to let us know of any hallucinations that occur in the course of your use of Toby.