ML News - DeepMind builds Gopher | Google builds GLaM | Suicide capsule uses AI to check access (Video)

Your updates on everything going on in the Machine Learning world.

Sponsor: Weights & Biases

OUTLINE:
0:00 - Intro & Overview
0:20 - Sponsor: Weights & Biases
3:05 - DeepMind releases 3 papers on large language models
11:45 - Hugging Face Blog: Training CodeParrot from scratch
14:25 - Paper: Pre-Training vision systems with noise
15:45 - DeepMind advances Quantum Mechanics
16:45 - GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model
18:45 - Colin Raffel calls for building ML models like we build Open-Source software
22:05 - A rebuke of the hype around DeepMind’s math paper
24:45 - Helpful Things
32:25 - Suicide Capsule plans AI to assess your mental state before use
35:15 - Synthesia raises 50M to develop AI avatars

Weights & Biases Embedding Projector
https://twitter.com/_ScottCondron/sta
https://docs.wandb.ai/ref/app/feature
Weights & Biases

DeepMind releases 3 papers on large language models
https://deepmind.com/blog/article/lan
https://arxiv.org/pdf/2112.04426.pdf
https://kstatic.googleusercontent.com
https://arxiv.org/pdf/2112.04359.pdf
https://deepmind.com/research/publica

Hugging Face Blog: Training CodeParrot from scratch
https://huggingface.co/blog/codeparro

Paper: Pre-Training vision systems with noise
https://mbaradad.github.io/learning_w

DeepMind advances Quantum Mechanics
https://deepmind.com/blog/article/Sim
https://storage.googleapis.com/deepmi
https://github.com/deepmind/deepmind-

GoogleAI trains GLaM: 1 Trillion Parameters Mixture of Experts Model
https://ai.googleblog.com/2021/12/mor

Colin Raffel calls for building ML models like we build Open-Source software
https://colinraffel.com/blog/a-call-t

A rebuke of the hype around DeepMind’s math paper

Helpful Things
https://twitter.com/huggingface/statu
https://docs.cohere.ai/prompt-enginee
https://github.blog/2021-12-08-improv
https://huggingface.co/blog/data-meas
https://huggingface.co/spaces/hugging
https://blogs.microsoft.com/ai-for-bu
https://techcommunity.microsoft.com/t
https://github.com/minitorch/minitorc
https://minitorch.github.io/
https://pandastutor.com/
Pandas Tutor - visualize Python pandas code
https://github.com/IAmPara0x/yuno
https://colab.research.google.com/dri
https://www.reddit.com/r/MachineLearn
https://www.drivendata.org/competitio
https://www.reddit.com/r/MachineLearn
https://www.uttt.ai/
[2112.02721] NL-Augmenter: A Framework for Task-Sensitive Natural Language Augmentation
https://arxiv.org/pdf/2112.02721.pdf
https://github.com/GEM-benchmark/NL-A
https://www.reddit.com/r/MachineLearn

Suicide Capsule plans AI to assess your mental state before use
Sci & Tech - SWI swissinfo.ch

Synthesia raises 50M to develop AI avatars
https://techcrunch.com/2021/12/08/syn
https://www.synthesia.io/