Broken Silicon 49: Nvidia A100, Training Game AI, Neural Networks | AI Developer Interview
🕑 Added 2020-05-19 06:01:01 +0000 UTCHot off the heels of the announcement of Nvidia A100, we have an AI Developer on to talk about what these massive GPU’s are actually used for – AI & ML applications.
1) 1:08 AI Buzzwords & Introductions (some sound issues in the first 5 min)
2) 5:50 What is a Neural Network?
3) 12:40 Challenges in Training Neural Networks
4) 16:08 Sparsity and Pruning
5) 23:50 How will AI Improve our Lives?
6) 35:29 Bottlenecks to AI Research
7) 40:15 AI & ML in Gaming
8) 45:55 CUDA Intrenchment, AMD’s ability to enter the market
9) 49:10 Cerebras & Graphcore
10) 54:05 AMD vs Nvidia Graphics
11) 1:01:25 Comparing Synthetic AI to Biological Brains
https://www.thispersondoesnotexist.com/
https://devblogs.nvidia.com/nvidia-ampere-architecture-in-depth/
https://www.cerebras.net/cerebras-wafer-scale-engine-why-we-need-big-chips-for-deep-learning/
https://arxiv.org/pdf/1803.03635.pdf
https://arxiv.org/pdf/1807.01281.pdf
https://en.wikipedia.org/wiki/Reinforcement_learning
https://en.wikipedia.org/wiki/Concept_learning
https://en.wikipedia.org/wiki/Unsupervised_learning#cite_note-2
https://arxiv.org/abs/1912.02875
https://arxiv.org/pdf/1912.02877.pdf
https://www.alexirpan.com/2018/02/14/rl-hard.html
https://ai.facebook.com/blog/state-of-the-art-open-source-chatbot/
https://openai.com/blog/jukebox/
https://www.pnas.org/content/pnas/116/43/21854.full.pdf
Comments
TSPCFS
that isn't Toms idea? It was AMD's. (well, it almost certainly was an idea before AMD implemented it)
Dominik Koc
Also sounds like this guy/industry would absolutely love your idea (tom) to super glue a high power ssd to a gpu to use as a memory pool.
Dominik Koc
AI realizes how fucking shitty humanity is and decides to off us. Honestly... totally justified
Moore's Law Is Dead
This is pretty funny
Edward Huff
In this spirit of thispersondoesnotexist, gwern made this funny website: https://www.thiswaifudoesnotexist.net/
ishould
I wonder if there is some kind of service like thispersondoesntexist.com but for generating custom human faces. Like if I wanted a stock photo of an asian woman with ginger hair, 80's style glasses, and earrings it could just generate varieties of a human with those specifications.
German englisch...I love it :) Nice informing episode!
Awesome episode! I think it would be a cool idea to train an a.i. To help train other a.i. Programs!
Aaron
Great Broken Silicon. Personally from the gaming side though I'd be more interested in AI or ML for companion characters or NPC's in RPG titles than FPS's. I think it's the last real boundary to truly immersive experiences in those sorts of titles.
Kameron Alexander
Ayyy let’s go new Broken Silicon