Gå frakoblet med Player FM -appen!
Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH
Manage episode 452400129 series 3574631
Unlock the future of automotive AI with insights from Ashutosh and Guru Prashad of BOSS India, as they unravel the transformative potential of Small Language Models (SLMs) in vehicles. Discover how these compact powerhouses are reshaping the landscape of vehicular edge systems by offering customization and performance reliability, all while keeping data privacy at the forefront. Dive into the captivating interplay between SLMs and their larger counterparts, Large Language Models (LLMs), and learn how they together address domain-specific tasks and complex computations in the cloud. This episode promises to equip you with a deeper understanding of why SLMs are the secret sauce for advancing automotive AI in this data-sensitive era.
We also spotlight the remarkable optimization journey of the Tiny Llama 1.1 model. Learn about the fine-tuning process that brought about an astounding 700% improvement in throughput and a drastic reduction in model size. Uncover the fascinating world of edge deployment using devices like Pi 4B and Jetson Oren Nano, and explore the audio and chat functionalities that are setting new standards in vehicular AI. Finally, imagine the future of personalized interactions in cars, where generative AI transforms the way we communicate and engage with our vehicles and surroundings. This episode is a treasure trove of forward-thinking solutions and innovative ideas, perfect for anyone eager to explore the cutting edge of automotive AI.
Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
Kapitler
1. Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH (00:00:00)
2. Leveraging Small Language Models in Automotive (00:00:24)
3. Automotive AI Model Benchmarking and Optimization (00:13:26)
4. Future Applications of Small Language Models (00:29:31)
24 episoder
Manage episode 452400129 series 3574631
Unlock the future of automotive AI with insights from Ashutosh and Guru Prashad of BOSS India, as they unravel the transformative potential of Small Language Models (SLMs) in vehicles. Discover how these compact powerhouses are reshaping the landscape of vehicular edge systems by offering customization and performance reliability, all while keeping data privacy at the forefront. Dive into the captivating interplay between SLMs and their larger counterparts, Large Language Models (LLMs), and learn how they together address domain-specific tasks and complex computations in the cloud. This episode promises to equip you with a deeper understanding of why SLMs are the secret sauce for advancing automotive AI in this data-sensitive era.
We also spotlight the remarkable optimization journey of the Tiny Llama 1.1 model. Learn about the fine-tuning process that brought about an astounding 700% improvement in throughput and a drastic reduction in model size. Uncover the fascinating world of edge deployment using devices like Pi 4B and Jetson Oren Nano, and explore the audio and chat functionalities that are setting new standards in vehicular AI. Finally, imagine the future of personalized interactions in cars, where generative AI transforms the way we communicate and engage with our vehicles and surroundings. This episode is a treasure trove of forward-thinking solutions and innovative ideas, perfect for anyone eager to explore the cutting edge of automotive AI.
Learn more about the EDGE AI FOUNDATION - edgeaifoundation.org
Kapitler
1. Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH (00:00:00)
2. Leveraging Small Language Models in Automotive (00:00:24)
3. Automotive AI Model Benchmarking and Optimization (00:13:26)
4. Future Applications of Small Language Models (00:29:31)
24 episoder
Alle episoder
×1 EDGE AI BLUEPRINTS: Enhancing Urban Safety with Edge AI Approaches to Pedestrian and Traffic Management 1:00:29
1 Panel Discussion - EDGE AI TAIPEI - Revolutionizing Edge Computing with AI-Driven Innovations 58:42
1 Revolutionizing Edge Devices with Energy-Efficient Generative AI Techniques 50:19
1 Transforming Edge AI Education: Insights from Harvard's Dr. Vijay Janapa Reddi 59:56
1 Recap of the "Beyond Chatbots - The Journey of Generative AI to the Edge" 8:31
1 Crafting Artistic Images with Embedded AI with Alberto Ancilotto of FBK 31:30
1 Revolutionizing Software Development with GenAI-Powered Edge Solutions with Anirban Bhattacharjee of Wipro 28:43
1 Tomorrow's Edge AI: Cutting-Edge Memory Optimization for Large Language Models with Seonyeong Heo of Kyung Hee University 30:29
1 Revolutionizing Automotive AI with Small Language Models with Alok Ranjan of BOSCH 31:59
1 From tinyML to the edge of AI: Introducing the EDGE AI FOUNDATION 14:09
1 Unveiling the Technological Breakthroughs of ExecuTorch with Meta's Chen Lai 31:24
1 Revolutionizing TinyML: Integrating Large Language Models for Enhanced Efficiency 27:06
1 Harnessing Edge AI: Transforming Industries with Advanced Transformer Models with Dave McCarthy of IDC and Pete Bernard of tinyML Foundation 33:53
1 Transforming the Edge with Generative AI: Unraveling Innovations Beyond Chatbots with Danilo Pau, IEEE Fellow from STMicroelectronics 6:47
1 Revolutionizing Weather Forecasting with Acoustic Smart Technology 25:04
Velkommen til Player FM!
Player FM scanner netter for høykvalitets podcaster som du kan nyte nå. Det er den beste podcastappen og fungerer på Android, iPhone og internett. Registrer deg for å synkronisere abonnement på flere enheter.