The Future is Fine Tuned (with Dev Rishi, Predibase)
Manage episode 420005406 series 3514761
Dev Rishi is the founder and CEO of Predibase, the company behind Ludwig and LoRAX. Predibase just released LoRA Land, a technical report showing 310 models that can outcompete GPT-4 on specific tasks through fine-tuning. In this episode, Dev tries (pretty successfully) to convince me that fine-tuning is the future, while answering a bunch of interesting questions, like:
- Is fine-tuning hard?
- If LoRAX is a competitive advantage for you, why open-source it?
- Is model hosting becoming commoditized? If so, how can anyone compete?
- What are people actually fine-tuning language models for?
- How worried are you about OpenAI eating your lunch?
I had a ton of fun with Dev on this one. Also, check out Predibase’s newsletter called fine-tuned (great name!) and LoRA Land.
23 episoder