"Illusions" affect "reliability"! Salesforce executives say "trust in large models has declined," and usage has decreased
Salesforce has encountered several challenges with large model technology in practical applications. When given more than 8 instructions, it begins to omit instructions, which is not ideal for tasks that require precise handling. Additionally, AI can experience a phenomenon known as "drift," where "when users ask unrelated questions, the AI agent loses focus on its primary objectives."