Playing Minecraft with ChatGPT

100,892
0
Published 2024-02-17
Meet Andy, a Minecraft bot that you can talk to and who can actually do stuff. He is built with ChatGPT and mineflayer. He is kind of an idiot, but occasionally smart. Watch as he mines, crafts, builds, fights, talks, and survives.

Mindcraft GitHub: github.com/kolbytn/mindcraft
Patreon: www.patreon.com/emergentgarden
Discord: discord.gg/ZsrAAByEnr
My twitter: twitter.com/max_romana
Kolby's twitter: twitter.com/kolbytn
Kolby's Paper: arxiv.org/abs/2301.12050
Voyager: voyager.minedojo.org/
Mineflayer: github.com/PrismarineJS/mineflayer
Music:    • C418 - Haggstrom - Minecraft Volume A...  

Timestamps:
(0:00) Meet Andy
(1:11) What can Andy do?
(6:22) Surviving with Andy
(7:32) Mindcraft
(12:10) Andy is an idiot
(15:46) Dangerous Code (watch before running)
(16:34) Open End

☻/
/ ▌ copy me
/ \

All Comments (21)
  • @Noizzed
    Andy so realistic he rage quitted when the Creeper exploded
  • @squarewheel9113
    Imagine 100 or even a thousand of these working collaboratively. Imagine exploring in Minecraft and stumbling upon a civilization of AI bots all going through their daily routines to advance and automate processes.
  • @aidan6620
    6:57 ""Attacking a creeper"? What creeper? OH MY go-" love how andy served as a warning but it failed anyway
  • @u12bdragon
    7:13 that's so cute after he crashed and rejoined he said sorry
  • @protoney8122
    The fact that he builds like a 3d printer is very funny for me
  • @galvinvoltag
    Think of a server. A server where Andy is the admin.
  • @Gameinger16
    I find it so endearing honestly. ChatGPT is already so excessively polite and then when you make it into this assistant that's clearly working so hard, it's just so nice. The messages when it crashes or dies are so apologetic it makes my heart melt. I know it's only an AI but this thing is so endearing.
  • @yahoo642
    The perfect base for a horrifying horror mod, which turns Andy into herobrine without your knowledge. He slowly starts to creep around, and say darker and darker stuff.
  • @raymundo2302
    It's a law of youtube that content creators will become more likely to upload a minecraft video with time
  • @ChazaLegend
    5:40 “And he will defend himself from hostile mobs!” Proceeds to charge at the zombies and slaughter them without even giving them a chance to attack.
  • @AnslordMC
    12:25 I love how Andy doesn't place a bed, and instead digs a hole to fight a creeper. 💀
  • @fizipcfx
    now i want the "FUNCTIONS DESCRIBE THE WORLD" in every video
  • @hanna_maria
    I would absolute love watching a little community of bots playing together. I feel like they’d get up to some interesting stuff and I’d love to find out more about their “thought processes” during. So cool
  • Videos using GPT4 and a community of Andy bots would be cool to see. also congrats when you hit 100k subs, it's coming up quick
  • I cant wait to see the future of Minecraft chatbots. This fascinates me
  • @redthunder6183
    You can use a multi model design where you have a potential fine tuned image to text generator so whenever you talk to Andy, it will take a screenshot, convert it to a text description of the world, and give it to GPT to assist with function calling since now it has more information of the world. For example now “go to that mountain” would work
  • @Animesh0404
    Coolest thing I've seen today, What a time to be alive!!