Code 2025
Enterprise Deep Research: The Next Killer App for Enterprise AI — Ofer Mendelevitch, Vectara
Overview
This talk introduces enterprise deep research as a powerful application for AI agents, focusing on its ability to conduct in-depth, multi-step investigations within private enterprise data. It highlights the challenges of factual accuracy in generative AI and presents an agent operating system designed to mitigate hallucinations and ensure robust information retrieval for enterprise-grade deployments.
Who should watch
- AI Engineers
- Product Managers
- Builders working on enterprise AI solutions
- Those facing challenges with factual accuracy in AI applications
- Individuals interested in agent operating systems and RAG workflows
Key takeaways
- Enterprise deep research involves AI agents autonomously searching and synthesizing information from private enterprise data sources to generate comprehensive reports with citations.
- Factual accuracy remains a top challenge for AI customers, with approximately 73% citing it as their primary concern.
- An agent operating system is crucial for enterprise-grade AI, offering features like multimodal ingestion, hybrid retrieval, hallucination detection and correction, security, and customizability.
- Victara's hallucination detection model, HHM, has achieved over 5 million downloads, underscoring its significance in mitigating AI inaccuracies.
- Key use cases for enterprise deep research include responding to RFPs by querying internal documents, generating on-demand employee onboarding guides from various data sources, and creating industry-specific reports like investment memos in financial services.
- The process involves multi-agent collaboration, reflection, synthesis, and parallel execution, querying enterprise data with high accuracy and hallucination mitigation.
- Corpus understanding enables effective planning based on the available enterprise data.
Notable quotes
*Factual accuracy is their top challenge right now.*
*Hallucinations are still a problem and you want to base your applications on really robust information.*
Unofficial community note. Prefer the recording for nuance.