1,731 subscribers
Gå frakoblet med Player FM -appen!
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714
Manage episode 460978186 series 2355587
Today, we're joined by Abhijit Bose, head of enterprise AI and ML platforms at Capital One to discuss the evolution of the company’s approach and insights on Generative AI and platform best practices. In this episode, we dig into the company’s platform-centric approach to AI, and how they’ve been evolving their existing MLOps and data platforms to support the new challenges and opportunities presented by generative AI workloads and AI agents. We explore their use of cloud-based infrastructure—in this case on AWS—to provide a foundation upon which they then layer open-source and proprietary services and tools. We cover their use of Llama 3 and open-weight models, their approach to fine-tuning, their observability tooling for Gen AI applications, their use of inference optimization techniques like quantization, and more. Finally, Abhijit shares the future of agentic workflows in the enterprise, the application of OpenAI o1-style reasoning in models, and the new roles and skillsets required in the evolving GenAI landscape.
The complete show notes for this episode can be found at https://twimlai.com/go/714.
733 episoder
Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714
The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)
Manage episode 460978186 series 2355587
Today, we're joined by Abhijit Bose, head of enterprise AI and ML platforms at Capital One to discuss the evolution of the company’s approach and insights on Generative AI and platform best practices. In this episode, we dig into the company’s platform-centric approach to AI, and how they’ve been evolving their existing MLOps and data platforms to support the new challenges and opportunities presented by generative AI workloads and AI agents. We explore their use of cloud-based infrastructure—in this case on AWS—to provide a foundation upon which they then layer open-source and proprietary services and tools. We cover their use of Llama 3 and open-weight models, their approach to fine-tuning, their observability tooling for Gen AI applications, their use of inference optimization techniques like quantization, and more. Finally, Abhijit shares the future of agentic workflows in the enterprise, the application of OpenAI o1-style reasoning in models, and the new roles and skillsets required in the evolving GenAI landscape.
The complete show notes for this episode can be found at https://twimlai.com/go/714.
733 episoder
Alle episoder
×1 Evolving MLOps Platforms for Generative AI and Agents with Abhijit Bose - #714 58:08
1 Why Agents Are Stupid & What We Can Do About It with Dan Jeffries - #713 1:08:49
1 Automated Reasoning to Prevent LLM Hallucination with Byron Cook - #712 56:48
1 AI at the Edge: Qualcomm AI Research at NeurIPS 2024 with Arash Behboodi - #711 54:47
1 AI for Network Management with Shirley Wu - #710 53:44
1 Why Your RAG System Is Broken, and How to Fix It with Jason Liu - #709 58:03
1 An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708 1:15:09
1 Building AI Voice Agents with Scott Stephenson - #707 1:01:44
1 Is Artificial Superintelligence Imminent? with Tim Rocktäschel - #706 55:52
1 ML Models for Safety-Critical Systems with Lucas García - #705 1:16:06
1 AI Agents: Substance or Snake Oil with Arvind Narayanan - #704 54:22
1 AI Agents for Data Analysis with Shreya Shankar - #703 48:24
1 Stealing Part of a Production Language Model with Nicholas Carlini - #702 1:03:30
1 Supercharging Developer Productivity with ChatGPT and Claude with Simon Willison - #701 1:14:15
1 Automated Design of Agentic Systems with Shengran Hu - #700 59:30
Velkommen til Player FM!
Player FM scanner netter for høykvalitets podcaster som du kan nyte nå. Det er den beste podcastappen og fungerer på Android, iPhone og internett. Registrer deg for å synkronisere abonnement på flere enheter.