OpenAI Has No Moat, Google's Godfather of AI Quits & The Rise of Open Source LLMs | E13

In Episode 13 of This Day in AI We Discuss the Leaked Internal Google Document, "We Have No Moat, and Neither Does OpenAI", Discuss "The Godfather" of AI leaving Google, Discuss The Implications of Open Source LLM Advancement, Cover Open Assistant's Comparable Model to ChatGPT, OpenAI's Code Interrupter and Touch of Democratizing LLM Alignment.

If you like this episode please consider subscribing and liking the episode to help others discover the podcast.

TIMESTAMPS: ==== 00:00 - Godfather of AI Quits Google Cold Open 00:17 - Google & OpenAI Have No Moat: Advancement of Open Source LLMs 21:13 - 'Godfather of AI' Quits Google 30:54 - Open Assistant & Training LLMs using AI 40:52 - What Increased Prompt Sizes Mean & Long Range Transformers 50:49 - AI Agents, AI Disruption & Mark Zuckerberg's Agent Plan for Meta

SOURCES ==== https://www.semianalysis.com/p/google-we-have-no-moat-and-neither https://www.nytimes.com/2023/05/01/technology/ai-google-chatbot-engineer-quits-hinton.html https://www.theverge.com/2023/4/26/23699633/mark-zuckerberg-meta-generative-ai-chatbots-instagram-facebook-whatsapp https://arxiv.org/pdf/2305.01625.pdf https://twitter.com/tanayj/status/1653243500354322436?s=46&t=uXHUN4Glah4CaV-g2czc6Q https://restofworld.org/2023/chatgpt-taking-kenya-ghostwriters-jobs/ https://www.oneusefulthing.org/p/it-is-starting-to-get-strange https://www.nvidia.com/en-au/autonomous-machines/embedded-systems/ https://open-assistant.io/chat