1. EachPod

LLMs and Multimodal AI with Dr. Stefania Druga of Google

Author
Dr. Joan Palmiter Bajorek / Stefania Druga
Published
Mon 29 Apr 2024
Episode Link
None

In this episode, Dr. Stefania Druga (she/her), Research Scientist on the Bard (now Gemini) team at Google, shares insights into her work on developing multimodal AI applications. She explains how Bard, a LLM, is trained on a massive amount of internet data, enabling it to understand and generate text, summarize content, and interact with images. They cover the advancements in AI and importance of multimodal capabilities that extend beyond text to include images and other data forms, pushing the boundaries of AI's application in daily life.


Stefania Druga Quotes

📊 Data Set Sizes: "You can think of what does it mean to scrape the entire internet and that's pretty much it...all the data that was ever created digitally and has the right permissions."
⚙️ “These AI assistants are becoming now embedded in not only standalone applications like Bard and ChatGPT, but also in a variety of products...they can become embedded in your calendar to help with smart planning” 
🚀 “I realized in 2016 that AI, voice assistants, machine learning are going to be huge. So I started thinking of how do we teach the next generation? That's how I started working on Cognimates & launched a platform.”


Resources

  • Fast.ai: Making neural nets uncool again
  • LangChain: Build context-aware, reasoning applications with LangChain’s flexible abstractions & AI-first toolkit
  • Stefania’s publications: stefania11.github.io
  • Cognimates: Stefania’s coding education project started @ MIT Media Lab


Stefania Druga is a Research Scientist at Google Gemini AI. She was a principal researcher at the Center of Applied AI Research at the University of Chicago. She graduated with a PhD in Creative AI Literacies at the University of Washington and a master of science at MIT. During her PhD, she did several research internships at Google X, Microsoft Research, and Fixie.ai focusing on LLM applications for developer tools, programming languages, and data science applications. She loves trail running & drawing with robots. Connect with Stefania: LinkedIn & Twitter

Learn More

YouTube! Watch the episode live @YourAIRoadmap
Connect with Joan on LinkedIn

✨📘 Buy the Bestselling Wiley Book: Your AI Roadmap: Actions to Expand Your Career, Money, and Joy. Featured in Forbes!

Who is Joan?

Ranked the #4⁠⁠ in Voice AI Influencer, ⁠⁠Dr. Joan Palmiter Bajorek⁠⁠ is the CEO of ⁠⁠Clarity AI⁠⁠, Founder of ⁠⁠Women in Voice⁠⁠, & Host of ⁠⁠Your AI Roadmap⁠⁠. With a decade in software & AI, she has worked at Nuance, VERSA Agency, & OneReach.ai in data & analysis, product, & digital transformation. She's an investor & technical advisor to startup & enterprise. A CES & VentureBeat speaker & Harvard Business Review published author, she has a PhD & is based in Seattle.

Disclaimer: Our links may have affiliate codes. This is an educational podcast and not intended as legal, career, or financial advice. Seek professional gu...

Share to: