Storyboard versus Guided video
Seedance 2.0 by Dreamina AI only lets you upload one reference video. That becomes a problem the moment you also need an empty video carrying audio for lipsync. The reference slot is gone. I tested two workarounds on a downloaded dance clip and I want others to try the same, because one run is not a conclusion. The setup: - Turn the source into a storyboard (extract frames, build a grid image, feed it as a visual reference). - Compress the 10 second source into a 2 second video at 8 fps (Seedance's minimum duration), sampling frames evenly to keep the motion arc intact. Both transformations were done locally with Claude Code driving ffmpeg. No cloud step, no upload round trip. Claude Code wrote the frame extraction, the grid composition, and the resample-and-rewrap into 8 fps in one pass. That part of the pipeline took minutes to set up and runs on any laptop. Same prompt for both runs: two humanoid robots in a junkyard doing the exact dance movement. What I saw: - The compressed 2 second video works. The robots dance. Timing carries over, body mechanics translate, choreography is recognizable. - The storyboard reference is not following the storyboard. The model picks up posture cues but the motion is gone. The dance turns into a slideshow of unrelated poses stitched together. My working theory: motion is not pose. Storyboards freeze geometry and kill the temporal signal. Frame-sampled short videos keep both, even crushed to 2 seconds at 8 fps. If this holds, the practical implication is that you can buy back your second upload slot by shrinking the reference, but only along the video path. Storyboards would not be a substitute. But I have run this twice, with one clip, on one prompt. That is not enough. If you work with Seedance, please try it. Pick any motion-heavy reference, run both versions (storyboard grid vs. compressed micro-video at 8 fps), keep the prompt identical, and post your results. I am especially curious about: