AI in the majority world and model distillation

Chris and Daniel take some time to cover recent trends in AI and some noteworthy publications. In particular, they discuss the increasing AI momentum in the majority world (Africa, Asia, South and Central America and the Caribbean), and they dig into Hugging Face’s recent model distillation results.

Join the discussion

Changelog++ members support our work, get closer to the metal, and make the ads disappear. Join today!

Sponsors:

• DigitalOcean – DigitalOcean now offers three managed databases — PostgreSQL, MySQL, and Redis. Get started for free with a $50 credit. Learn more at do.co/changelog.
  


• All Things Open – Exploring open source, open tech, and the open web in the enterprise. Raleigh, NC — October 13-15, 2019
  


• The Brave Browser – Browse the web up to 8x faster than Chrome and Safari, block ads and trackers by default, and reward your favorite creators with the built-in Basic Attention Token. Download Brave for free and give tipping a try right here on changelog.com.
  

Featuring:

• Chris Benson – Website, GitHub, LinkedIn, X
• Daniel Whitenack – Website, GitHub, X

Show Notes:

AI in the majority world:

• NeurIPS publications by country


• “Best” universities according to the Times Higher Education


• ICLR in Ethiopia


• Google AI offices:
  
  
  
  • Bangalore
  
  
  • Ghana
  
  
  • Beijing
  
  
  
  


• Deep Learning Indaba


• Southeast Asia Machine Learning School


• Facebook’s AI for India summit


• AI Singapore


• Indonesia AI research center

Artificial intelligence probes dark matter in the universe

DistilBERT from Hugging Face

Three People-Centered Design Principles for Deep Learning

Papers with code

Something missing or broken? PRs welcome!