Image by Author # Introduction All tutorials on data science make detecting outliers appear to be quite easy. Remove all values greater than three standard deviations; that’s all there is to it. But once you start working with an actual dataset where the distribution is skewed and a stakeholder asks, “Why did you remove …
Catalyzing breakthroughs in science By proving it could navigate the massive search space of a Go board, AlphaGo demonstrated the potential for AI to help us better understand the vast complexities of the physical world. We started by attempting to solve the protein folding problem, a 50-year grand challenge of predicting the 3D structure of …
How AI Innovation Is Paving the Path to AGI — Google DeepMind Read More »
Bayesian statistics you’ve likely encountered MCMC. While the rest of the world is fixated on the latest LLM hype, Markov Chain Monte Carlo remains the quiet workhorse of high-end quantitative finance and risk management. It is the tool of choice when “guessing” isn’t enough and you need to rigorously map out uncertainty. Despite the intimidating …
An Intuitive Guide to MCMC (Part I): The Metropolis-Hastings Algorithm Read More »
Image by Author # Introduction BitNet b1.58, developed by Microsoft researchers, is a native low-bit language model. It is trained from scratch using ternary weights with values of (-1), (0), and (+1). Instead of shrinking a large pretrained model, BitNet is designed from the beginning to run efficiently at very low precision. This reduces …
Run Tiny AI Models Locally Using BitNet A Beginner Guide Read More »
Acknowledgements This research was co-developed by Google DeepMind and Google Research. Google DeepMind: Andrea Burns, Anton Raichuk, Arianna Manzini, Bart van Merrienboer, Burcu Karagol Ayan, Dominic Masters, Drew Purves, Jenny Hamer, Julia Haas, Keith Anderson, Matt Overlan, Maxim Neumann, Melanie Rey, Mustafa Chasmai, Petar Veličković, Ravi Rajakumar, Tom Denton, Vincent Dumoulin Google Research and Google …
Three ways Google scientists use AI to better understand nature — Google DeepMind Read More »
an interesting library the other day that I hadn’t heard of before. PythoC is a Domain-Specific Language (DSL) compiler that allows developers to write C programs using standard Python syntax. It takes a statically-typed subset of Python code and compiles it directly down to native machine code via LLVM IR (Low Level Virtual Machine Intermediate …
Write C Code Without Learning C: The Magic of PythoC Read More »
Image by Editor # Introduction Python decorators are tailor-made solutions that are designed to help simplify complex software logic in a variety of applications, including LLM-based ones. Dealing with LLMs often involves coping with unpredictable, slow—and frequently expensive—third-party APIs, and decorators have a lot to offer for making this task cleaner by wrapping, for instance, …
5 Powerful Python Decorators to Optimize LLM Applications Read More »
Embracing the opportunity ahead, responsibly We believe the promise of AI in education can only be achieved by developing it responsibly. One essential facet of this is doing so in close partnership with the entire education ecosystem. When my team and I met with Damian Harvey, Interim Head of C2k, he emphasized this point. He …
How AI is giving Northern Ireland teachers time back Read More »
of a series about distributed AI across multiple GPUs: Introduction In the previous post, we saw how Distributed Data Parallelism (DDP) speeds up training by splitting batches across GPUs. DDP solves the throughput problem, but it introduces a new challenge: memory redundancy. In vanilla DDP, every GPU holds a complete copy of the model parameters, gradients, …
Image by Editor # Introduction Data science projects usually begin as exploratory Python notebooks but need to be moved to production settings at some stage, which might be tricky if not planned carefully. QuantumBlack’s framework, Kedro, is an open-source tool that bridges the gap between experimental notebooks and production-ready solutions by translating concepts surrounding project …
A Guide to Kedro: Your Production-Ready Data Science Toolbox Read More »
