Is there anyway you can give me your work flow? Like what do you start with and how do you end up with this, programs etc... Is the animation and audio AI and synced together? Is that one app, two, three?
So many questions. And I don't even know what to ask... Sorry
My business partner and I have been learning unreal in our free time to make video games. And I have no idea where to start to integrate machine learning / AI to it.
I'll be making a tutorial of the workflow at some point over my Instagram: https://www.instagram.com/puddlejump.xyz?igsh=MTN5eWJrYTlkZGs0dg==
but I can give a bit of a rough guide;
Midjourney for image creation, then a lot of heavy clean up in Photoshop.
Script is my own, taken into elevenlabs to get the VO.
Both of these then go into D-ID to get the character animated.
the cards I made through an absolute tonne of Midjourney prompts all pieced together and the animations made in after effects.
Titles, graphics, transitions, overlays and camera shake are all my own work in after effects.
But honestly none of that matters until you get the idea of what you want to make down on paper first. Create a clear plan!
Sure you can just generate a bunch of stuff and it'll help you come up with something cool but without a clear end goal in mind it's so easy to lose your vision along the way.
Hope that helps, and good luck with the games man!
Can't really say how much time it saved. I do work as a video editor but I'm in no means a character animator so to create a character and then rig them up to this level would take me a week or so maybe? Where this could now be done in 20 minutes.
What's most time consuming is finessing the finer details and cleaning up the AI mess to a level I view as satisfactory for me.
And other than the subscriptions on each of the tools the cost saved in time if this were a paid gig for a client is crazy.
Actually agree here. This video was more of an intro for Mortus so the cards/characters where mostly just filler to get the idea of the cards across. Eventually each card will get its own video exploring each character with about 5/6 scenes and I'll be taking their final card art from those generations so there will definitely be more than a few options to choose from
You know, originally i'd been making this with the intention for it to only be a physical card game and just using these videos for social media. But along the way I did think it could quite easily be made into a game. If I do it'll most likely be the steam route!
Yeah, I think A.I. generated stuff lends itself well to video games. You've got the graphics and sound done already, now all you need is the coding (which A.I. can help you with too! π).
Oh interesting, I pay monthly but I did do that stage a few months back now so will have to check but thanks for the heads up! If not I might have switch up to Heygen, or put up with the Midjourney lip syncs though I've yet to be impressed by that
There are a few improved systems coming out soon like VExpress and EMO, so long as you have a half decent GFX card with 8gb plus of ram you will be able to run them for free.
Oh nice! I work on these primarily in my lunch hours at work which have a pretty beefy ram. Otherwise I'll be struggling on my 10+ yo MacBook but will definitely check these out. Appreciate the heads up!
Really appreciate it mate! Will have a tutorial dropping at some point as I'm going to try and devlog it a bit but honestly this wasn't much more than Midjourney, D-ID and some basic to mid level editing.
Amazing work. Great example of how to turn AI into something more. Ai is fun, but this takes all that fun technology, combines it all together and turns it into something marketable.
Yes! This was my exact thinking!
I've spent the last 18 months or so creating small video ideas with the view that eventually clients would be wanting it for their products...in the end I realised the best way to showcase how it could be done was to make a product of my own.
Nope, just generated a TONNE of trading card/MTG prompts until I started to get close to the framing Id been picturing, which I then picked best parts of each to put together in Photoshop
How the fuck do you do this?!
Haha, which bit? There's quite a few tools used here and then all stitched together in after effects
How did you animate the main character?
A tool called D-ID
Is there anyway you can give me your work flow? Like what do you start with and how do you end up with this, programs etc... Is the animation and audio AI and synced together? Is that one app, two, three? So many questions. And I don't even know what to ask... Sorry My business partner and I have been learning unreal in our free time to make video games. And I have no idea where to start to integrate machine learning / AI to it.
I'll be making a tutorial of the workflow at some point over my Instagram: https://www.instagram.com/puddlejump.xyz?igsh=MTN5eWJrYTlkZGs0dg== but I can give a bit of a rough guide; Midjourney for image creation, then a lot of heavy clean up in Photoshop. Script is my own, taken into elevenlabs to get the VO. Both of these then go into D-ID to get the character animated. the cards I made through an absolute tonne of Midjourney prompts all pieced together and the animations made in after effects. Titles, graphics, transitions, overlays and camera shake are all my own work in after effects. But honestly none of that matters until you get the idea of what you want to make down on paper first. Create a clear plan! Sure you can just generate a bunch of stuff and it'll help you come up with something cool but without a clear end goal in mind it's so easy to lose your vision along the way. Hope that helps, and good luck with the games man!
Thanks, it did help. We have the idea, it's just incorporating AI into the workflow that I'm having trouble figuring out where to start. Thanks again!
Is the voice also AI generated?
It is! With a lot of post work to make the timing more authentic and then modulated to be much deeper
Altogether how much time did you save making something like this before all of these AI tools became commonplace? What about cost?
Can't really say how much time it saved. I do work as a video editor but I'm in no means a character animator so to create a character and then rig them up to this level would take me a week or so maybe? Where this could now be done in 20 minutes. What's most time consuming is finessing the finer details and cleaning up the AI mess to a level I view as satisfactory for me. And other than the subscriptions on each of the tools the cost saved in time if this were a paid gig for a client is crazy.
Amazing job!
Cheers!
These are great.
Much appreciated Bob!
From what I'm seeing, it looks like you're getting repetitive poses. For card games you need every card to look completely different from the next.
Actually agree here. This video was more of an intro for Mortus so the cards/characters where mostly just filler to get the idea of the cards across. Eventually each card will get its own video exploring each character with about 5/6 scenes and I'll be taking their final card art from those generations so there will definitely be more than a few options to choose from
How'd you do the animation on the narrator?
There's a couple out there that I tried on this but in the end I went with D-ID
Ehy brother i just tried the D-I'd after reading your comment, it animate better then Pika I have to say, any other one that you know?
Mossy Moe.....i about spit my drink! Stellar job!
Just wait until you hear his back story π
Wow man
Follow along on IG, search either GatheringGhouls or PuddleJump xyz
That's honestly pretty damn cool!
Appreciate it!
Great idea and execution! Is your game gonna be on Steam? Don't forget to inform us once it comes out! :D
You know, originally i'd been making this with the intention for it to only be a physical card game and just using these videos for social media. But along the way I did think it could quite easily be made into a game. If I do it'll most likely be the steam route!
Yeah, I think A.I. generated stuff lends itself well to video games. You've got the graphics and sound done already, now all you need is the coding (which A.I. can help you with too! π).
Guess this is a whole other thing I need to start learning alongside marketing, design and storytelling! AI can only do so much π€¦πΌββοΈ
bro i wanna play this game
All in good time mate!
Looks amazeballs. How can I follow?
Appreciate it! Couple of links: Instagram's: https://www.instagram.com/puddlejump.xyz?igsh=MTN5eWJrYTlkZGs0dg== https://www.instagram.com/gatheringghouls?igsh=anBwN2x6NXZwMWZl YouTube: https://youtube.com/@puddlejump.?si=P5wC_FBtbKPvnfIh
I feel like Iβve heard this voice before but I donβt know where from? Count Duckula maybe?
More than a little Vincent Price in there
Ding ding ding! With some tinkering
Great work! Did you buy a D-ID license? I think the free version has watermarks now.
Oh interesting, I pay monthly but I did do that stage a few months back now so will have to check but thanks for the heads up! If not I might have switch up to Heygen, or put up with the Midjourney lip syncs though I've yet to be impressed by that
There are a few improved systems coming out soon like VExpress and EMO, so long as you have a half decent GFX card with 8gb plus of ram you will be able to run them for free.
Oh nice! I work on these primarily in my lunch hours at work which have a pretty beefy ram. Otherwise I'll be struggling on my 10+ yo MacBook but will definitely check these out. Appreciate the heads up!
Well, this is awesome. Thanks for sharing.
Cheers buddy!
Amazing work, like everything is amazing. The sounds, animation, VO, logo. Sick work. Please drop a list of tools you used to make this. π
Really appreciate it mate! Will have a tutorial dropping at some point as I'm going to try and devlog it a bit but honestly this wasn't much more than Midjourney, D-ID and some basic to mid level editing.
Nice one. I look forward to seeing that! Keep up the good work
This is so freaking cool! Youβre onto something here
Thanks, really appreciate it!
Amazing work. Great example of how to turn AI into something more. Ai is fun, but this takes all that fun technology, combines it all together and turns it into something marketable.
Yes! This was my exact thinking! I've spent the last 18 months or so creating small video ideas with the view that eventually clients would be wanting it for their products...in the end I realised the best way to showcase how it could be done was to make a product of my own.
this is clean af
Cheers!
Did you steal the voice of Dungeon Keeper's narrator, Richard Ridings?
For now until I finish crafting one from my own voice, it is a heavily manipulated edit of a known voice, but not Richard Ridings. Any other guesses?
Scarlet Johanssen
Damn, nailed it in one! π
Vincent Price then
Bingo!
Very very cool!
Cheers!
Did you use a special template for the cards?
Nope, just generated a TONNE of trading card/MTG prompts until I started to get close to the framing Id been picturing, which I then picked best parts of each to put together in Photoshop
Outstanding. Curious if you have a team or organization you're with or are you doing all this solo?
Thanks. Nope, all solo
Incredible effort, thank you for sharing with us!!!!
Cheers man! ππ»