This AI model lets you generate videos using only your photos

Published on:

As one of many newest developments within the AI panorama, AI-powered video turbines have been rising in recognition. These providers work equally to different generative AI instruments: Describe your required content material in a immediate, and the bot responds, hopefully delivering what you need.

Launched in June, Luma Dream Machine is an AI video generator with two capabilities: text-to-video and image-to-video. Luma solely creates quick movies — just a few seconds in size — however you’ll be able to prolong a video one other 5 seconds by including extra particulars to the immediate.

What’s extra, Luma is now operating Dream Machine 1.5, its newest mannequin, which is designed to higher perceive your prompts and generate extra reasonable movies extra rapidly.

- Advertisement -

Here is methods to use Luma Dream Machine’s AI to create a brief video.

Find out how to use Luma Dream Machine

To begin, head to the Dream Machine web site. Click on the “Attempt now” button and you will be prompted to check in with a Google account.

Luma affords a wide range of plans based mostly on what number of movies it’s essential generate monthly and the way you propose to make use of them. The free plan affords you 30 movies every month with no business use allowed, whereas the Lite plan prices $10 monthly for 40 movies. 

The most costly possibility is the Premier plan priced at $500 monthly, which comes with 2,400 movies every month. 

- Advertisement -

Textual content-to-video immediate

Let’s begin with Luma’s text-to-video generator. Within the immediate discipline, kind an outline of the video you need. Be particular and embrace any necessary particulars. 

You too can describe the temper or environment you wish to create. Be certain the choice for “Improve immediate” is checked, as that helps Dream Machine flip easy descriptions into extra detailed eventualities. 

See also  Samsung starts mass production for memory chips for on-device AI

In order for you the video to maintain looping, verify the choice for Loop. After you have typed the outline, click on Create.

Your video will queue up. Relying on the complexity of the scene, you’ll have to attend a number of minutes or longer for the video to seem. Hover your mouse over the video to play it.

- Advertisement -

Now you can fee the video by giving it a thumbs up or thumbs down. I requested Dream Machine to create a video of a knight in shining armor battling a dragon respiratory hearth with each of them in entrance of a fort. The video regarded good, however the hearth got here out of nowhere as a substitute of the dragon’s mouth. For that motive, I gave it a thumbs down.

If the video would not meet your necessities, you’ll be able to at all times attempt once more. Revise your unique immediate to right no matter ingredient did not come out proper. In my case, I rewrote the immediate to particularly point out that the dragon ought to be taking pictures hearth out of its mouth. 

With the revised immediate, Dream Machine did a greater job. Every video you request seems on the primary display screen to be able to play or tweak any of them.

Picture-to-video immediate

Now that we have tried Luma’s text-to-video characteristic, let’s transfer on to its image-to-video generator.

This functionality enables you to add pictures that Luma will use to create a video as a substitute of writing a immediate from scratch. You may then submit your request with or with out a description. 

Two pictures work greatest right here — the primary acts because the beginning body and the second because the ending body. Dream Machine’s job is to create footage in between these two frames. The pictures have to be in JPG, JPEG, or PNG format and ideally have a 16:9 side ratio, however Dream Machine can work with different codecs as properly.

To do this, click on the picture icon within the immediate. Choose the 2 pictures you want to use. You may swap the place of the 2 pictures by clicking the curved arrow between them or swap out one of many pictures by clicking the X. 

Let’s attempt submitting the request with none immediate to see what Dream Machine cooks up by itself.

Hover over the video to see the way it performs. You may prolong the video by 5 seconds by clicking the Lengthen button and including one other ingredient to the immediate.

In my case, Dream Machine prolonged a video I had requested based mostly on two pictures of the Statue of Liberty. The additional few seconds added a pleasant contact by lingering on a detailed up of the statue’s iconic torch.

See also  What is Artificial General Intelligence (AGI) and Why It’s Not Here Yet: A Reality Check for AI Enthusiasts

To generate a extra particular video, add your two pictures after which kind an outline of what you need.

Hover over the ensuing video to see if it matches your description. If not, you’ll be able to attempt once more or prolong the video by including extra particulars to the immediate. 

I added two portrait pictures — certainly one of Herbert Hoover and one other of Franklin D. Roosevelt. I requested Dream Machine to create a video altering Hoover into FDR, and it pulled off an efficient morph of the thirty first president turning into the thirty second.

I additionally tried the identical two pictures however with out a description. On this case, the outcomes weren’t fairly as satisfying, as Dream Machine failed so as to add the cool morphing. Even once you take the picture route, including a immediate can assist steer the outcomes to higher meet your expectations.

When you’re glad with the video, click on the Obtain button to obtain it as an MP4 file. You may then play it in your default media participant or tweak it in your favourite video editor.

General, I used to be happy with the efficiency of Dream Machine. I did need to tweak and finesse the prompts to get my desired outcomes, however that is true of any generative AI instrument. In some circumstances, the movies took a very long time to generate, so you may need to be affected person. 

To study extra about Dream Machine, take a look at Luma’s FAQ web page.

- Advertisment -

Related

- Advertisment -

Leave a Reply

Please enter your comment!
Please enter your name here