Microsoft first introduced its “groundedness” detection feature in March. To use it, a genAI application must connect to grounding documents, which are used in document summarization and RAG-based Q&A scenarios, Microsoft said. Since then, it said, customers have been asking what they can do once erroneous information is detected, besides blocking it.
“This highlights a significant challenge in the rapidly evolving generative AI landscape, where traditional content filters often fall short in addressing the unique risks posed by generative AI hallucinations,” Microsoft Senior Product Marketing Manager Katelyn Rothney wrote in a blog post.
Building on the company’s existing groundedness detection, the Correction tool allows Azure AI Content Safety to both identify and correct hallucinations in real-time — before users of genAI applications encounter them. It works by first flagging the ungrounded content. Then the Azure Safety system initiates a rewriting process in real-time to revise the inaccurate portions ensure alignment with connected data sources.