Golioth Introduces AI-Ready Infrastructure for IoT Developers

Today’s world is mostly driven by data and connectivity. The launch of AI-ready IoT infrastructure by Golioth marks a significant milestone. The new platform is basically designed for developers. It is poised to reshape how the Internet of Things (IoT) will evolve in the near future. IoT has been lately a buzzword in tech circles […]

Zoom Launches AI-Driven Docs Feature to Revolutionize Workplace Collaboration

The tech world is evolving at a rapid pace and AI is reshaping the way we work continuously. Meanwhile, the latest innovation of Zoom is a perfect example of it. The startup has come up with an AI-powered Docs feature that is basically designed to enhance workplace collaboration. It highlights how AI can transform tasks […]

Following OnlyFans, AI Companions Target Lonely Men in Growing Market

Technology is advancing at a breakneck pace. Line between reality and virtuality is increasingly being blurred. Jenny is the latest buzz. It is a virtual companion and created by startup LushAI. It is learned to rival the popular subscription-based platform OnlyFans. It appears as an attractive Asian-American woman on her social media profiles. It is […]

Reddit Invests $40 Million in AI Startup to Boost Ad Tech

Reddit has lately acquired startup Memorable AI. It is renowned for using artificial intelligence (AI) in the prediction of memorable images and videos. The acquisition is a strategic move and highlights commitment of Rellddit to enhancing ad tech. It is said to be benefiting the advertisers on the platform. The financial details of the acquisition […]

Hayo Launches AI-Powered IoT Platform to Enhance Operations in Developing Markets

It is important to bridge technological gaps in the developing markets. New York City-based global innovator in digital solutions, Hayo, has come up with new Internet of Things (IoT) platform that is designed to support Machine-to-Machine (M2M) and consumer IoT use cases. It is learned to be offering immense potential to mobile network operators (MNOs) […]

Effective Strategies to Safeguard Yourself and Loved Ones from AI Scam Calls

This is a digital age and the rise of artificial intelligence (AI) has brought many conveniences. However, it has also invited some new threats and especially in the form of AI-powered scam calls. The scams are increasingly becoming sophisticated. It is suggested to adopt effective strategies to protect ourselves. Let us explore the evolving world […]

Why does AI hallucinate?

On April 2, the World Health Organization launched a chatbot named SARAH to raise health awareness about things like how to eat well, quit smoking, and more.

But like any other chatbot, SARAH started giving incorrect answers. Leading to a lot of internet trolls and finally, the usual disclaimer: The answers from the chatbot might not be accurate. This tendency to make things up, known as hallucination, is one of the biggest obstacles chatbots face. Why does this happen? And why can’t we fix it?

Let’s explore why large language models hallucinate by looking at how they work. First, making stuff up is exactly what LLMs are designed to do. The chatbot draws responses from the large language model without looking up information in a database or using a search engine.

A large language model contains billions and billions of numbers. It uses these numbers to calculate its responses from scratch, producing new sequences of words on the fly. A large language model is more like a vector than an encyclopedia.

https://medium.com/media/260ffdc0d69d4e1186a4969c41c75c63/href

Large language models generate text by predicting the next word in the sequence. Then the new sequence is fed back into the model, which will guess the next word. This cycle then goes on. Generating almost any kind of text possible. LLMs just love dreaming.

The model captures the statistical likelihood of a word being predicted with certain words. The likelihood is set when a model is trained, where the values in the model are adjusted over and over again until they meet the linguistic patterns of the training data. Once trained, the model calculates the score for each word in the vocabulary, calculating its likelihood to come next.

So basically, all these hyped-up large language models do is hallucinate. But we only notice when it’s wrong. And the problem is that you won’t notice it because these models are so good at what they do. And that makes trusting them hard.

Can we control what these large language models generate? Even though these models are too complicated to be tinkered with, few believe that training them on even more data will reduce the error rate.

You can also ensure performance by breaking responses step-by-step. This method, known as chain-of-thought prompting, can help the model feel confident about the outputs they produce, preventing them from going out of control.

But this does not guarantee 100 percent accuracy. As long as the models are probabilistic, there is a chance that they will produce the wrong output. It is similar to rolling a dice even if you tamper with it to produce a result, there is a small chance it will produce something else.

Another thing is that people believe these models and let their guard down. And these errors go unnoticed. Perhaps, the best fix for hallucinations is to manage the expectations we have of these chatbots and cross-verify the facts.


Why does AI hallucinate? was originally published in Becoming Human: Artificial Intelligence Magazine on Medium, where people are continuing the conversation by highlighting and responding to this story.

How AI and Cloud Technology are Revolutionizing the 2024 Olympics

The Paris 2024 Summer Olympic Games is being said to be a landmark event. The reason is not just for the athletes and their quest for medals. There is another reason. It is the use of technological innovations to enhance the experience for everyone involved. Artificial intelligence (AI) and cloud technology are at the forefront. […]

The Role of AI and IoT in Modern Business

The combination of Artificial Intelligence (AI) and Internet of Things (IoT) devices is changing how businesses work. The two are making businesses more efficient and innovative. The partnership helps companies in various industries to use resources in better-than-before way and improve operations. Simultaneously, the convergence is helping businesses to gain a competitive edge with data-driven […]