GDG Philly

Google I/O. Some thoughts: the model seems to be multimodal in, but not multimodal out. Imagen-3 and music gen models are still detached from Gemini as standalone components. Merging all modality I/O natively is the inevitable future: - enables tasks like "use a more robotic voice", "speak 2x faster", "edit this image iteratively", and "generate consistent comic strips". - does not lose information across modal boundaries, e.g. emotion and background sound. - opens up new in-context capabilities. You can teach the model to combine different senses in novel ways with few-shot examples. GPT-4o doesn't do it perfectly, but it gets the form factor correct. In words of Andrej's LLM-as-OS analogy: we need the model to natively support as many file extensions as possible. One thing Google is doing right: they are finally making serious efforts to integrate AI into the search box. I sense the agent flow: planning, real-time browsing, and multimodal input, all from the landing page. Google's strongest moat is distribution. Gemini doesn't have to be the best model to be the most used one in the world.