A motions from mixamo, applied to an iClone dummy, exported as an mp4 for motion reference. On the Galaxy platform, used the AI Video generator and the Kling Motion control to create character movement. Then, using the Galaxy AI lipsync generator with the Sync Lipsync option and a separate character audio mp3 file. The two of the three times it worked well. One time, not. The section with the bulls chasing is still animatic. Didn't want to try AI on that until I got the character motion working. Couldn't stop the AI from creating mouth movement with the character motion. But, when I lip synched, the audio file/AI overrode the original unwanted mouth/lip movement.

Created with a mix of everything. iClone, Mixamo, PS, Premiere, several Galaxy.ai features, and Dzine. For the Friday 8May Zoom call.

Hi, all - here's my latest, again combining CA5 with AI elements. The first story (Movie Theater Rules) is the most recent one. In this one, the interior theater lobby background started as a stock image with no characters. I edited the image a bit in AI to suit my needs, then had Seedance animate the characters in the background. I made some additional adjustments in Photoshop and Final Cut Pro, then pulled the video into CA5 as a prop and made it the background of the scene. The blue monster's flying popcorn was also animated in AI. I had the image of the popcorn bucket, and I created the first frame of the animation with a green background. Then I had Seedance animate the popcorn flying out of the bucket and all across the frame. That took multiple tries - the popcorn bucket and the camera had to remain stationary, but AI kept moving them. The flying popcorn scene was a bit trickier. I did the animation of the characters in CA5 and placed the AI popcorn animation on the Z axis so that it lined up with the blue monster's position. So Officer Bob and the first row of seats were in front of the flying popcorn, then I had the popcorn animation with the green screen background, then everything else behind it. I output just the Bob/front row/popcorn layers as one video. Then I turned off those layers and output the scene again with only the background layers. In Final Cut Pro I layered the two outputs, and applied the chromakey (green screen) filter so the green background disappeared and Bob and the first row of seats were in front of the popcorn, and everything else was behind the popcorn, creating the illusion I was going for. Later in the video, we actually see the movie that the characters are watching, and those clips were done entirely in AI... the dancing dinos/bunny and the pirate ship scene. I inserted them into the movie theater frame using green screen again.

I applied some lessons learned from the Friday zoom class that focused on applying motions to characters using AI. I downloaded the motion from Adobe's Mixamo, which is free to subscribers. I applied the motion to a dummy character in iClone and rendered it out as an mp4. I used the Galaxy's video to video generator using the Kling Motion Control model and applied the motion to my character. And I generated the video without any prompt at all. You be the judge.

@Thomas Jennings @Arlene Dilworth @Ernesto Guerrero @Simona Adelina @Helene J @G. Vern Morris @Nancy Moon CONCLUSION 1: Kling Motion Control 3.0 can't animate if your video reference is an animation of rigged characters (like those from Cartoon Animator) - it has to be either live footage or 3D (like iClone) CONCLUSION 2: Kling Motion Control 3.0 struggles in getting the Character to be animated as traditional animation, still kept it 3D - I am attaching both videos here. When I used only Kling 3.0 (not motion control) to animate an image addint the text "Make this is a 2D traditional Animation animated at 12 fps" - it did a better job. Also Kling Motion Control 3.0 can't follow Cartoon Animator motions, I assume it is becase 2D motion from rigged characters could be too abstract for Kling - it kept crashing and not doing the job. - We kept burning credits testing multiple approaches for 1.5+ hrs, and nothing. - When we used 3D motion from iClone (thanks @Helene J for providing this simple clip), it worked on the first try. For this, I followed 5 steps. ✅ 1. Get a motion video ✅ 2. Get the first frame rendered as an image of the motion video ✅ 3. Get the character you need ✅ 4. Create the first frame with your character and your background in the position of the first frame ✅ 5. Use Kling Motion Control 3.0 - have the image move the same way as in the video