ML News - Microsoft trains 530B model | ConvMixer model fits into single tweet | DeepMind profitable (Video)

Your latest upates on what’s happening in the Machine Learning world.

OUTLINE:
0:00 - Intro
0:16 - Weights & Biases raises on 1B valuation (sponsored)
2:30 - Microsoft trains 530 billion parameter model
5:15 - StyleGAN v3 released
6:45 - A few more examples may be worth billions of parameters
8:30 - ConvMixer fits into a tweet
9:45 - Improved VQGAN
11:25 - William Shatner AI chats about his life
12:35 - Google AI pushes material science
14:10 - Gretel AI raises 50M for privacy protection
16:05 - DeepMind’s push into ML for biology
19:00 - Schmidhuber laudates Kunihiko Fukushima for Bower Award
21:30 - Helpful Things
22:25 - Mosaic ML out of stealth mode
23:55 - First German self-driving train
24:45 - Ex-Pentagon Chief: China has already won
26:25 - DeepMind becomes profitable

Sponsor: Weights & Biases

References:
Microsoft Trains 530B Parameter Model
https://www.microsoft.com/en-us/resea

StyleGAN 3 Code Released

https://colab.research.google.com/git

When do labels help?

ml_paper.bruh
https://openreview.net/pdf?id=TVHS5Y4

Improved VQGAN
https://openreview.net/pdf?id=pfNyExj7z2

William Shatner “AI” & Storyfile
https://www.livescience.com/william-s
https://www.storyfile.com/

GoogleAI Finds Complex Metal Oxides
https://ai.googleblog.com/2021/10/fin

GretelAI raises 50M Series B
https://techcrunch.com/2021/10/07/gre
https://gretel.ai/
https://gretel.ai/blog/why-privacy-by

DeepMind’s Push in ML for Bio
https://www.biorxiv.org/content/10.11
https://deepmind.com/blog/article/enf

Kunihiko Fukushima wins Bower Award: Schmidhuber Congratulates
https://www.fi.edu/laureates/kunihiko
- YouTube

Helpful Things
https://github.com/UKPLab/beir#beers-
https://arxiv.org/pdf/2104.08663.pdf
https://bayesoptbook.com/
https://github.com/nvlabs/imaginaire/
https://github.com/NVlabs/imaginaire/

MosaicML out of Stealth Mode

https://www.mosaicml.com/blog/founder
Mosaic ML | Explore
https://github.com/mosaicml/composer
https://mosaicml-composer.readthedocs

Germany’s first self-driving train
https://techxplore.com/news/2021-10-g

Ex-Pentagon Chief: China has already won tech war
https://nypost.com/2021/10/11/pentago

DeepMind becomes profitable
https://bdtechtalks.com/2021/10/07/go