On the premiere episode of the AI Inside podcast, hosts Jeff Jarvis and Jason Howell discuss AI copyright issues with Common Crawl Foundation's Rich Skrenta regarding news outlets limiting access to content they publish publicly, impacting the integrity of Common Crawl's internet archive. In recent years, the archive has been used by LLMs as AI training data, and the implications of restricting information have a dramatic impact on the data quality that survives.
INTERVIEW
Introduction and background on AI Inside podcast
Discussion of the recent AI oversight Senate hearing Jeff testified at
Introduction of guest Rich Skrenta from Common Crawl Foundation
Overview of Common Crawl and its goals to archive the open web
Discussion of how Common Crawl data is used to train AI models
News publishers wanting content removed from Common Crawl
Debate around copyright, fair use, and AI’s “right to read”
Mechanics of how Common Crawl works and what it archives
Concerns about restricting AI access to data for training
Risk of regulatory capture and only big companies being able to use AI
Discussion of recent court ruling related to web scraping
Hopes for Common Crawl's growth and evolution
NEWS BITES
Interesting device announcement from CES - Rabbit R1 with Perplexity AI integration
Study on actual risk of AI automating jobs away in the near future
Learn more about your ad choices. Visit megaphone.fm/adchoices