PyTorch Documentary; Karpathy's Keynote Speech; Kyutai's Moshi; Andrew Ng's Talk

Vision Geek Newsletter #8

Hello there,

If you are looking for some inspiring content to watch over the weekend in the AI space, below is a quick list of interesting videos for you.

Official PyTorch Documentary

PyTorch team has produced a documentary covering the journey of the library from the initial days and it’s impact on the ongoing AI revolution along with sponsors like AMD, AWS, Meta and Microsoft. The documentary unveils the authentic narrative of PyTorch’s inception, attributing its existence to a dedicated group of unsung heroes and shares the strength of the PyTorch community. Inspiring watch.

Andrej Karpathy’s Keynote Speech

Andrej Karpathy recently gave the keynote speech at the UC Berkeley AI Hackathon 2024 Awards ceremony. Apparently he loves the vibe of hackathons. He discussed about the current state of AI, his early days at OpenAI, LLM OS, his vision for AGI and how working on side projects have the potential to snowball into something bigger. This video also showcases the winning projects from the hackathon.

Open Source Alternative to GPT-4o

A French AI Lab called Kyutai Labs has released a real time voice enabled model called Moshi, a potential open source alternative to OpenAI’s GPT-4o. The team claims that in just 6 months, with a team of 8, the Kyutai research lab has developed the model from scratch and their mission is to build and democratize artificial general intelligence through open science (the real OpenAI?).

During the presentation, the Kyutai team interacted with Moshi to illustrate its potential as a coach or companion for example, and its creativity through the incarnation of characters in roleplays. Code and model weights to be open sourced soon. Chat with Moshi at moshi.chat. Currently conversations are limited to 5 mins.

Andrew Ng on AI Agentic Workflows

Andrew Ng recently gave a talk at Sequioa’s AI Ascent event on AI agentic workflows. “AI Agents” has become a buzzword recently and being tossed around in many places. In this talk, Andrew Ng presents concrete examples of agentic workflow and how it can improve the performance of LLMs. He also mentioned his experience using an open source version of Devin (the AI Software Engineer) - ChatDev.

Hope you find these videos engaging. Let us know what you have been watching lately.

Cheers.