In December, we kicked off the agentic era by releasing an experimental version of Gemini 2.0 Flash — our highly efficient workhorse model for developers with low latency and enhanced performance. Earlier this year, we updated 2.0 Flash Thinking Experimental in Google AI Studio, which improved its performance by combining Flash’s speed with the ability …
In the world of machine learning, we obsess over model architectures, training pipelines, and hyper-parameter tuning, yet often overlook a fundamental aspect: how our features live and breathe throughout their lifecycle. From in-memory calculations that vanish after each prediction to the challenge of reproducing exact feature values months later, the way we handle features can …
ML Feature Management: A Practical Evolution Guide Read More »
Research Published 28 July 2023 Authors Yevgen Chebotar, Tianhe Yu Robotic Transformer 2 (RT-2) is a novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalised instructions for robotic control High-capacity vision-language models (VLMs) are trained on web-scale datasets, making these systems remarkably good at recognising visual …
RT-2: New model translates vision and language into action Read More »
Simple methods to replace cluttered bar charts with crisp, reader-friendly visuals. Photo by Steffen Petermann on Unsplash (a bubble’s added by me) Statue can be found in Weimar — Park an der Ilm (but Shakespeare obviously doesn’t speak) Welcome to the ninth post in my “Plotly with code” series! If you missed the first one, …
Technologies Published 29 August 2023 Authors Sven Gowal, Pushmeet Kohli New tool helps watermark and identify synthetic images created by Imagen AI-generated images are becoming more popular every day. But how can we better identify them, especially when they look so realistic? Today, in partnership with Google Cloud, we’re launching a beta version of SynthID, …
The first (and most important) step of any fine-tuning process is data collection. Here, I extracted title-thumbnail pairs from my channel in a 2-step process. First, I used YouTube’s search API to extract the video IDs for all the videos on my channel. Second, I used YouTube’s video API to extract the title and thumbnail …
Fine-tuning Multimodal Embedding Models | by Shaw Talebi Read More »
Research Published 19 September 2023 Authors Žiga Avsec and Jun Cheng New AI tool classifies the effects of 71 million ‘missense’ mutations Uncovering the root causes of disease is one of the greatest challenges in human genetics. With millions of possible mutations and limited experimental data, it’s largely still a mystery which ones could give …
A catalogue of genetic mutations to help pinpoint the cause of diseases Read More »
10 books with valuable insights about AI science and engineering Great books for AI Engineering — Plus ‘Brave New Words’ (Image is Author’s own work) A few years ago I recommended 21 books in Great Books for Data Science and Great Books for Data Science 2. Since then a lot has changed. While data scientist …
Robots are great specialists, but poor generalists. Typically, you have to train a model for each task, robot, and environment. Changing a single variable often requires starting from scratch. But what if we could combine the knowledge across robotics and create a way to train a general-purpose robot?
Data Preparation & Exploratory Analysis Now that we’ve outlined our approach, let’s take a look at our data and what kind of features we’re working with. From the above, we see our data contains ~197,000 deliveries, with a variety of numeric & non-numeric features. None of the features are missing a large percentage of values …
