“GenAI is like a first-year consultant. They feel like they have to say something, even if it is wrong.” — David Ray, chief privacy officer, BigID
A related generative AI problem is not merely what data it accesses, but what can it infer or guess based on that data? Those speculative efforts from genAI may turn out to be more problematic than anything else, said David Ray, chief privacy officer at BigID, a data security, privacy, compliance, and governance provider.
“The information being collected at the prompt is often being collected in ways that people don’t realize. Things like age and gender can be inferred,” he said.
Ray pointed to “model drift” as especially worrisome. “As the AI evolves, can you trust it?” He added that the hallucination problem with genAI can’t be overstated. “GenAI is like a first-year consultant. They feel like they have to say something, even if it is wrong.”
