Iceberg for Agents: Building AI-Ready Data Pipelines

Details

• Date:

  January 8, 2025

• Time:

  8:30 PM IST

• Duration:

  60 mins

Summary

AI agents fail in production because they're overwhelmed with data but starved for context. LLM models aren't the problem. The bottleneck is the data stack: fragmented silos, inconsistent definitions, and logic hidden in tribal knowledge. Agents need structured, reliable, and interpretable context—not just data access. In this session, we'll show how Apache Iceberg becomes the backbone of AI-ready pipelines. You'll learn how to elevate your Iceberg implementation from a storage format to a live context layer that powers structured retrieval-augmented generation (RAG), schema-aware agents, and autonomous reasoning grounded in truth.

• ✅ Iceberg Foundations for AI - from ACID to Time Travel
• ✅ From Rows to Relationships - The role of the semantic layer
• ✅ Structured RAG in Practice - Fully open source
• ✅ Solving State Skew: How snapshot isolation prevents agents from reasoning across inconsistent data states
• ✅ The 4 levels of AI-ready data: Raw → Structured → Context → Action
• ✅ Hybrid retrieval architecture: Combining structured RAG (deterministic) with vector RAG (contextual)
• ✅ Live demo: Open-source stack with semantic query translation
• ✅ Architecture diagrams, real code, and production patterns