Extrapolating the spectacular performance of GPT3 into the future suggests that the answer to life, the universe and everything is just 4.398 trillion parameters.

8:26 PM · Jun 10, 2020

68
674
78
3,829
Replying to @geoffreyhinton
Sheesh--when did 42 become 4.398 trillion? Deep #AI hypes up everything!
3
0
0
44
We messed up the decimal place.
0
0
0
2
Replying to @geoffreyhinton
can't we just backprop from 42?
0
0
0
71
Replying to @geoffreyhinton
was this tweet generated by GPT3?
0
0
0
23
Replying to @geoffreyhinton
and random.state(42) to get back to same trillion parameters
0
0
0
13
Replying to @geoffreyhinton
And how fast can we get to the 4.398 trillion parameters?
1
0
0
2
‌‍‌​؜͏ According to Moore's Law 4.398 trillion params (from current 0.175 trillion) could be achieved in just below 10 years. Fasten your seatbelt! ‌‍‌​؜͏
2
1
0
25
Replying to @geoffreyhinton
Where does the parameter number come from?
1
0
0
3