Accelerated Training by Amplifying Slow Gradients

Accelerated Training by Amplifying Slow Gradients

Tunadorable

55 лет назад

32,244 Просмотров
Grokfast: Accelerated Grokking by Amplifying Slow Gradients
https://arxiv.org/abs/2405.20233
https://github.com/ironjr/grokfast/tree/main

Support my learning journey either by clicking the Join button above, becoming a Patreon member, or a one-time Venmo!
https://patreon.com/Tunadorable
https://account.venmo.com/u/tunadorable

Discuss this stuff with other Tunadorks on Discord
https://discord.gg/64fWcSDGsJ

All my other links
https://linktr.ee/tunadorable
Ссылки и html тэги не поддерживаются

Комментарии:

Сейчас смотрят
Accelerated Training by Amplifying Slow Gradients 26:29
Accelerated Training by Amplifying Slow Gradients Tunadorable
15 Foods That are BETTER in the Air Fryer (and 5 that Aren't) 11:54
15 Foods That are BETTER in the Air Fryer (and 5 that Aren't) Empowered Cooks
Celebs React to Korean Food for the First Time!? 15:51
Celebs React to Korean Food for the First Time!? 영국남자 Korean Englishman
AdmiralBulldog Jakiro Fire Ownage - Dota 2 Pro Gameplay [Watch & Learn] 52:54
AdmiralBulldog Jakiro Fire Ownage - Dota 2 Pro Gameplay [Watch & Learn] Dota 2 Pro Gameplay [Watch & Learn]
Ata Ocağı (424-cü seriya) 34:58
Ata Ocağı (424-cü seriya) Xəzər Film
Stress-Management Techniques That Actually Work • The Habits of Happiness • Ep. 13 27:18
Stress-Management Techniques That Actually Work • The Habits of Happiness • Ep. 13 Pastor Rick
Drum Collections - High End Audiophiles SoundCheck - NBR MUSIC 01:03:19
Drum Collections - High End Audiophiles SoundCheck - NBR MUSIC Audiophile NBR Music
Choose Yoar Gift #chooseyourgift #gift #cat #banana #smile #giftforyou 0:10
Choose Yoar Gift #chooseyourgift #gift #cat #banana #smile #giftforyou Shyam Kumar (SKS)
The BEST OF STAND UP COMEDIAN Daliso Chaponda On Britain's Got Talent 20:25
The BEST OF STAND UP COMEDIAN Daliso Chaponda On Britain's Got Talent Punchline
Trump’s return to White House upends criminal investigations and convictions he’s faced 5:06
Trump’s return to White House upends criminal investigations and convictions he’s faced PBS NewsHour
Dasha's Dolls Are Gone Maria helps find dolls 39:32
Dasha's Dolls Are Gone Maria helps find dolls Vania Mania Kids
Идеальная форма участка для постройки дома 19:05
Идеальная форма участка для постройки дома BDD GROUP