Roope Rainisto

Cold Comfort ep01 scene 16 Seedance 2.0 and BeatBandit Working on just telling stories normally. I started working on this scene yesterday evening. The workflow is starting to become pretty solid. I didn't write a single specific genAI prompt by hand. I just wrote the script. BB took my script and wrote all the prompts.

Does everyone get to do this all the time? Do you have the chance to do this all time? I think no - there's the reality of time and money and resources... finite capital. In some fantasy world where everyone has both a pony and a mansion, they get to do it - but the answer usually is money.

Why would I deprive myself or anyone else of directing the film—the artistic choices involved and the transformative experience of collaborating with other people to realize it, improve it, and bring new meanings into it? Why would I as a screenwriter deprive my audience of a film executed from start to finish with intention? What’s the point?

One day in the near future when a writer can hand their screenplay into a tool, out comes a really great film adaptation of the script, and the writer puts this video out, are they merely a prompter that just wrote some words into a machine, the result is pure ai slop, and they have not created anything themselves?

@verge let me open the comments section

Netflix’s new INKubator studio will produce animated shorts with AI theverge.com/column/930118/…

I think fundamentally the notion that "closer to existing = better" is something I would challenge. This is different from before. Different doesn't mean better or worse - i.e. I never consider the current status quo of something to be the best that can ever be. Change can mean also that the new way is better in some aspects than what's the current way. Closer = more familiar. People don't like change. Anyway the hybrid question is interesting - what happens when there's 5 people and 25 agents. What are the team dynamics like then.

@rainisto What if there's a group of humans in one room, all prompting agents, in one project? Do you think we get closer?

I think humans influence each other not just through words but by physical presence - non-verbally, emotionally, in ways that are hard to put into words. So there are many additional elements involved that are lost in a digital space. But on a conceptual level, yes you are directing, making decisions, reacting, iterating.

@rainisto Do you consider a director on a set to be prompting his crew? Or is he doing something that can only exist in the physical word? Is prompting agents the same as prompting humans, just on a different time scale?

the script

Cold Comfort ep01 scene 16 Seedance 2.0 and BeatBandit Working on just telling stories normally. I started working on this scene yesterday evening. The workflow is starting to become pretty solid. I didn't write a single specific genAI prompt by hand. I just wrote the script. BB took my script and wrote all the prompts.

@henrydaubrez Have you figured out any tips of how it wouldn't degrade the visual quality? I've noticed that v2v on Seedance the output quality isn't quite as good when you do it like this. It looks slightly burnt out...

FIX YOUR SHOTS. DON’T REGENERATE THEM You don’t always need to regenerate a Seedance shot from scratch when it’s almost right. Sometimes you can throw it back into v2v, provide the existing shot, ask for specific modifications, and the model will actually fix or refine the original shot instead of reinventing everything. Doesn’t work every time. But when it works… it really works. Here I needed the model to use the character sheet with the mud instead of the other one, and it indeed fixed it after. Prompt KEEP UNCHANGED (PRESERVE): Boy's face identity, body proportions, pose, lighting direction, framing, background, junkyard environment, robotic crow (Socket), camera movement, timing, shot order, animation style. CHANGE ONLY: Add mud and dirt to the boy's face and clothes. NEW VERSION: The boy (Artie) has mud smudges on his cheek and temple, and dirt stains on his brown leather jacket and clothes, matching the dirt patterns in Image 1. The robotic crow interacts with him exactly as before. The lighting still hits the boy from the same direction. CONSTRAINTS: do not regenerate the entire scene. Do not alter face/body identity. Do not add extra logos. Maintain the same duration and pacing.

Nice way to automate Seedance video gen review 1) generate clips from shot inputs 2) make a script that takes a screenshot of each second, making a 4x4 frame out of it 3) run LLM that asks to compare given shot input against this result image, looking for things that do not match the inputs Running things with MCP, you can then have the AI automatically run those generations again, adjusting prompts and inputs - it's smart enough to automatically know how to fix the prompts and inputs for the second generation! (Yes you could also do this with Gemini and analyzing the video, but the image review alone is pretty fast and works well enough.)

What happens when you post a real Monet and say it’s AI? The coolest art social experiment I’ve seen in a while. Thank you @SHL0MS

Throwback reminder to this classic troll posting

Yes sure, it's the package. But there's zero chance Backdoors would be have been made if it wouldn't have first gone direct to YouTube and then shown success there. If it had been just some script from a random guy outside the industry of "there's backrooms there trust me it's spooky when it's done just right" nobody would have believed it. :) Nobody would have wanted to attach themselves to this.

Yes, this is a good example of what I’m saying: if you look at the names (Robert Patino, ex-HBO, the three producers of Saw, etc.), the reason a distributor like A24 or a financier jumps on a project (usually at the end of the process) is because of the people attached, in film jargon, “the package”. Without them, it won't be produced. There is no straight proof-of-concept-to-financier journey unfortunately.

This is the future way to pitch your stories and get them produced - make an AI version out of it, get it out. If people like it, then it's so so much more easier for a producer to agree to produce it for real - put money behind it.

@eliott__mogenet en.wikipedia.org/wiki/Backrooms…

Actually, doing a “proof of concept” in the entertainment industry is a good idea on paper. It feels like an MVP in the tech industry. But in reality, things get produced in Hollywood because of established reputation and networks. No one really cares about the "proof of concept" (even with millions of views)

Cold Comfort Ep01 Scene 10 test I didn't write any prompts. I wrote the script originally, used BeatBandit through the MCP, used Seedance through the API. The AI took my screenplay, wrote the genAI prompts, made the images, made the videos. I edited the clips finally together. 5 minutes in under one day. Yes by going fully hands off there are visual issues - obviously I could come in and fix things by hand - fix the prompts, edit the graphics (and Seedance doesn't like words in Finnish) - but it's pretty interesting to observe what's already possible fully automated -- think how far we have come in a year. It won't be long since before tons of writers will be publishing their stories as series on Youtube. Several new episodes each week. And their stories can be as niche as they possible want. And producers can discover new stories not by reading scripts but by watching them, and reading the comments from the viewers - finding actual evidence of popular appeal, and making decisions based on that.

@luminxbt Fully agree - the story needs to be good. Visuals alone won't be enough.

@rainisto gonna be funny seeing a million AI trailers drop with no actual script behind them production deals wont fix a weak story

authors and storytellers, the people who write the novels that movies are most often based upon, are using AI to go direct to consumer with animation the same way they already do with books and theres no amount of ad hominem attacks, boycotts or protests that will stop them

You watch this video and you get confused at this moment? You know that transition frames can also be used to communicate something about the mental state of the character? If someone gets boinked in the head you can have a frame of confusion - four eyes pointing in every direction - precisely to communicate also something else than just motion information? You want me to pull examples of how something like this is used in animation?

@rainisto @RealFrostings @Cattleh3rd @0kncn Porque si existe una forma correcta de hacerlo la deformación qué ves ahí es un movimiento claro en donde el personaje mueve su cabeza a otra dirección en lo hecho por la IA no se entiende cual es el movimiento que hace el personaje para pasar de un estado a otro

GPT Image 2 ile storyboard çizdim, sonra Seedance 2.0 ile bunu tam animasyon sahnesine çevirdim Bir rakun. Bir donut. Ve tamamen kontrolden çıkan çizgi film kaosu. Storyboard → cinematic cartoon video dönüşümü gerçekten deli hissettiriyor. AI artık sadece görsel üretmiyor, timing ve slapstick komedi de kurabiliyor Ve en absürt kısmı: Bunun tamamını sadece 10 dakikada yaptım.

It understands pretty much everything else about how animations work - why wouldn't it understand how transition frames look and when to apply them? (Exactly as this moment?) What would be "the correct look" for it? Why is the example I posted "the correct answer" for it, and the AI version not correct? Is the answer "because a human made this one"? This could be done dozens of different ways and you would say all of them are correct - and AI could do this in dozens of different ways and you would say they are all incorrect?

@rainisto @RealFrostings @Cattleh3rd @0kncn Eso es un frame de transición que se entiende mientras que lo hecho por la IA es un intento de frase de transición sin entender como funcionan

@liboar @justalexoki You can give a relevant slice of the previous animation as video input reference and ask it to edit just this one thing and it will change just that and leave the rest as is. It's a good example of not knowing what is nowadays possible.

@justalexoki Address the point, how do you adjust an animation if it's not right? Fine tuning the character? Lmao self reporting as having zero idea how animation works. "Good enough" slop

the cope here is genuinely amazing. they really have no idea what's coming