Only as good as the data

Practical AI: Machine Learning, Data Science, LLM

You might have heard that “AI is only as good as the data.” What does that mean and what data are we talking about? Chris and Daniel dig into that topic in the episode exploring the categories of data that you might encounter working in AI (for training, testing, fine-tuning, benchmarks, etc.). They also discuss the latest developments in AI regulation with the EU’s AI Act coming into force.

Join the discussion

Changelog++ members save 5 minutes on this episode because they made the ads disappear. Join today!

Sponsors:

• Assembly AI – Turn voice data into summaries with AssemblyAI’s leading Speech AI models. Built by AI experts, their Speech AI models include accurate speech-to-text for voice data (such as calls, virtual meetings, and podcasts), speaker detection, sentiment analysis, chapter detection, PII redaction, and more.
• Changelog News – A podcast+newsletter combo that’s brief, entertaining & always on-point. Subscribe today.

Featuring:

• Chris Benson – Twitter, GitHub, LinkedIn, Website
• Daniel Whitenack – Twitter, GitHub, Website

Show Notes:

Something missing or broken? PRs welcome!

Kapitler

1. Welcome to Practical AI (00:00:00)

2. Sponsor: Assembly AI (00:00:45)

https://www.assemblyai.com

3. Daniel @ GopherCon UK (00:04:08)

4. Categorizing training data (00:05:27)

5. Model complexity & data (00:08:34)

6. Framing data (00:11:10)

7. When to start from scratch (00:14:39)

8. Sponsor: Changelog News (00:17:23)

https://changelog.com/news

9. Hold out data (00:19:02)

10. Public benchmarks (00:22:05)

11. Categorization overlaps (00:25:54)

12. The best of both worlds (00:27:14)

13. Comparing to RAG (00:31:27)

14. UK AI act (00:34:09)

15. Unacceptable risks (00:38:25)

16. How much does it cover? (00:40:19)

17. When does enforcement start? (00:42:37)

18. Wrapping up (00:43:53)

19. Outro (00:44:53)