Contents0.1. Computational Convenience2. Mean and Median3. OLS is BLUE4. LS is MLE with normal errorsConclusion 0. Least Squares is used almost everywhere when it comes to numerical optimization and regression tasks in machine learning. It aims at minimizing the Mean Squared Error (MSE) of a given model. Both L1 (sum of absolute values) and L2 (sum of squares) …
Least Squares: Where Convenience Meets Optimality Read More »
ContentsNotesReferences Notes References [1] John M Jumper, Richard Evans, Alexander Pritzel, Tim Green, Michael Figurnov, Olaf Ron-neberger, Kathryn Tunyasuvunakool, Russ Bates, Augustin Zídek, Anna Potapenko, Alex Bridgland, Clemens Meyer, Simon A A Kohl, Andy Ballard, Andrew Cowie, Bernardino Romera-Paredes, Stanislav Nikolov, Rishub Jain, Jonas Adler, Trevor Back, Stig Petersen, David A. Reiman, Ellen Clancy, Michal …
Benchmarking the next generation of never-ending learners Read More »
previous article on organizing for AI (link), we looked at how the interplay between three key dimensions — ownership of outcomes, outsourcing of staff, and the geographical proximity of team members — can yield a variety of organizational archetypes for implementing strategic AI initiatives, each implying a different twist to the product operating model. Now …
Evolving Product Operating Models in the Age of AI Read More »
Notes [1] Abramson, J., Ahuja, A., Barr, I., Brussee, A., Carnevale, F., Cassin, M., Chhaparia, R., Clark, S., Damoc, B., Dudzik, A. and Georgiev, P., 2020. Imitating interactive intelligence. arXiv preprint arXiv:2012.05672. [2] Abramson, J., Ahuja, A., Brussee, A., Carnevale, F., Cassin, M., Fischer, F., Georgiev, P., Goldin, A., Harley, T. and Hill, F., 2021. …
Building interactive agents in video game worlds Read More »
With the new age of problem-solving augmented by Large Language Models (LLMs), only a handful of problems remain that have subpar solutions. Most classification problems (at a PoC level) can be solved by leveraging LLMs at 70–90% Precision/F1 with just good prompt engineering techniques, as well as adaptive in-context-learning (ICL) examples. What happens when you …
R.E.D.: Scaling Text Classification with Expert Delegation Read More »
Join Nolan Fortman and Logan Kilpatrick for a deep conversation with Dwarkesh Patel, host of the Dwarkesh podcast, and one of the 2024 TIME most influential people in AI. We chat about how the world is going to change with AI in the next 2 years, infinite AI dimensionality, creating content for the AI world, …
Advancing best-in-class large models, compute-optimal RL agents, and more transparent, ethical, and fair AI systems The thirty-sixth International Conference on Neural Information Processing Systems (NeurIPS 2022) is taking place from 28 November – 9 December 2022, as a hybrid event, based in New Orleans, USA. NeurIPS is the world’s largest conference in artificial intelligence (AI) …
Research Published 1 December 2022 Authors Julien Perolat, Bart De Vylder, Daniel Hennes, Eugene Tarassov, Florian Strub and Karl Tuyls DeepNash learns to play Stratego from scratch by combining game theory and model-free deep RL Game-playing artificial intelligence (AI) systems have advanced to a new frontier. Stratego, the classic board game that’s more complex than …
Mastering Stratego, the classic game of imperfect information Read More »
Research Published 6 December 2022 Authors Yoram Bachrach, János Kramár Agents cooperate better by communicating and negotiating, and sanctioning broken promises helps keep them honest Successful communication and cooperation have been crucial for helping societies advance throughout history. The closed environments of board games can serve as a sandbox for modelling and investigating interaction and …
GenAI systems affect how we work. This general notion is well known. However, we are still unaware of the exact impact of GenAI. For example, how much do these tools affect our work? Do they have a larger impact on certain tasks? What does this mean for us in our daily work? To answer these …
The Impact of GenAI and Its Implications for Data Scientists Read More »
