How Did Llama-3 Beat Models x200 Its Size?
115,867
Publicado 2024-04-22
And check out Datacurve.ai if you're interested: datacurve.ai/
In this video, I compiled the latest Llama-3 news and information that you might have missed. Llama-3 is actually very impressive, and I am going to find my jaws because I accidentally dropped it somewhere.
xAI News
[Grok-1] x.ai/blog/grok-os
[Grok-1.5 Vision] x.ai/blog/grok-1.5v
[Code] github.com/xai-org/grok-1
Llama-3 News
[Blog] ai.meta.com/blog/meta-llama-3/
[Huggingface] huggingface.co/collections/meta-llama/meta-llama-3…
[NVIDIA NIM] nvda.ws/3Jn5pxb
This video is supported by the kind Patrons & YouTube Members:
🙏Andrew Lescelius, alex j, Chris LeDoux, Alex Maurice, Miguilim, Deagan, FiFaŁ, Daddy Wen, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien, BIll Mangrum, owned, Janne Kytölä, SO, Richárd Nagyfi, Hector, Drexon, Claxvii 177th, Inferencer, Michael Brenner
[Discord] discord.gg/NhJZGtH
[Twitter] twitter.com/bycloudai
[Patreon] www.patreon.com/bycloud
[Music 1] massobeats - swing
[Music 2] massobeats - lush
[Music 3] massobeats - glisten
[Profile & Banner Art] twitter.com/pygm7
Todos los comentarios (21)
-
Sign up Shipd now to start earning while coding! tally.so/r/3jBo1Q And check out datacurve.ai/ if you're interested: datacurve.ai/ On a side note, I am also looking for some like-minded people that are down to work together. For video scripting to maybe revive the AI newsletter with me, feel free to hit me up on Discord if you’re interested!
-
Llama 3 is 8B instead of 7B because the increased vocabulary size -- llama 8B has a feature dimension of 4096. Therefore, the initial embedding layer goes from 32000*4096 to 128000*4096, and the final prediction layer goes from 4096*32000 to 4096*128000. Aka a difference of 800M parameters.
-
This 3rd phase of Zuck has really hit his stride, amazing.
-
I usually Hate Facebook but this time there doing a really good thing by pioneering open sourced ai
-
Open sourcing is better because it takes away the leverage of models like GPT4 and other closed sourced ones from their competitors. If you can't compete, disrupt the competition.
-
Congrats on graduating and good luck on your foray into doing more YouTube. Your videos always go beyond surface level news. It’s the reason you’re the only AI channel I watch, and why I watch all the videos you drop. Looking forward to seeing how your channel grows! -Niko
-
Congrats on graduating bro 🎓🎉👏 and to clarify, I'm not the "boss man," I only want to support your excellent work. Thank you for all your videos and excited to follow along your adventure 🙂
-
if you live long enough you see your self become a hero - reptile zuk
-
How the hell is Zuck the good guy in this?
-
Mistral 7B was released based on Llama 2 architecture, i can't wait after 2-5 months what Mistral will release based on this new way of training models by Meta AI
-
bro you should create an LLM primer playlist, from training to inference, from a to z.
-
I did not expect that I could run an LLM that can beat an older version of GPT-4 on my own PC this year. For reference, 70B runs at ~1 token/s on a 8C CPU. Not "interactive", but I sometimes switch tabs when asking GPT-4 something bigger too. And 8B runs at 60 tokens/s on my RTX 4080, which is more than interactive!
-
Peak thumbnail
-
Looking forward to see more tech stuff from you. Congrats on graduating btw!
-
Thanks for all of your great videos! Just keep us updated with the latest and greatest AI news and tutorials :)
-
Congratulations on graduating! 🎉That’s huge, and I have loved your videos
-
Hey, congrats on finishing university! Please do what you like to do the most. But in my opinion there are already a lot of AI-news youtubers that cover a lot of what is happening in the AI world on the surface but what I really like about your content is the way you try to go into one topic a bit deeper. I really like the entertaining but educational style of your videos, so keep up the great work.
-
Really looking forward to your next videos man! I know you will keep doing an amazing job! Will support patreon as soon as my startup is no longer just bleeding money 😂
-
Thank you for your videos. You're very instructive and clear in your assessments. Keep at it :)
-
Glad i found this chanel! This i high quality stuff!
