Generative AI in the Real World: Jay Alammar on Building AI for the Enterprise

Jay Alammar, director and Engineering Fellow at Cohere, joins Ben to talk about building AI applications for the enterprise, using RAG effectively, and the evolution of RAG into agents. Listen in to find out what kinds of metadata you need when you’re onboarding a new model or agent; discover how an emphasis on evaluation helps an organization improve its processes; and learn how to take advantage of the latest code-generation tools. Follow O'Reilly on: LinkedIn: https://www.linkedin.com/company/oreilly/ Facebook: http://facebook.com/OReilly Instagram: https://www.instagram.com/oreillymedia BlueSky: https://bsky.app/profile/oreilly.bsky.social