I Tried The New Ray3 AI Video Maker by Luma Labs

Previously yr, searches for “AI video maker” have skyrocketed by over 200%. This isn’t a shocker, as creators in all places are on the lookout for quicker, smarter methods to show concepts into visuals. Actually, the very thought of such AI instruments was to offer artistic freedom to everybody, whether or not with a videomaking background or not. Into this wave comes Luma AI Ray3, the most recent video-generation mannequin from Luma Labs.

Positioned as a “visible thought associate,” Ray3 is constructed to assist creators ideate, storyboard, and refine their movies inside a single interface. No less than that’s what the corporate goals at, as per its launch announcement. Powered by Ray3 for video and Photon for pictures, the system goals to push video creation from experimentation to execution, all in minutes.

I attempted my hand on the new Ray3. Right here, I share all about it, my expertise, and how one can attempt it out for your self. Learn on!

What’s Luma AI Ray3?

At its core, Luma AI Ray3 is the most recent improve to Luma Labs’ video-generation mannequin, designed to push previous the bounds of Ray2. In contrast to earlier iterations that targeted totally on rendering quick clips, Ray3 introduces a unified artistic layer: you’ll be able to ideate, experiment, and direct visible outputs with out leaving the interface.

The system combines two engines beneath one roof – Ray3 for video and Photon for pictures. This pairing means you’ll be able to transfer fluidly between nonetheless pictures and movement, treating them as components of the identical artistic course of.

But, probably the most attention-grabbing function Ray3 brings is its reference-driven consistency. The brand new AI video-gen mannequin helps you to lock types or characters throughout a number of pictures, one thing many different AI video makers nonetheless battle with.

Key Options of Luma AI Ray3

Aside from the reference-driven video-making, Ray3 has a bunch of latest options. Here’s a deep dive into all of those.

1. Boards for Structured Creativity

Ray3 introduces a number of boards – Artboard, Storyboard, and Moodboard. These let creators organise uncooked concepts into structured visuals. As an alternative of leaping straight into video, you’ll be able to form the feel and appear earlier than committing to era.

2. Modify with Pure Language

Want fast adjustments? Merely sort directions like “make it anime” and the mannequin edits your picture or video accordingly. This bridges the hole between skilled modifying instruments and on a regular basis artistic language.

3. Modify with Visible Cues

Some of the novel options I’ve personally seen in an AI video maker, Ray3, now helps you to modify a video by including visible cues to it. The AI mannequin is ready to interpret these cues and make adjustments to your video accordingly.

4. Reference for Fashion and Character Consistency

Some of the highly effective additions: reference-based era. By importing a visible reference, Ray3 can preserve constant types, environments, and even recurring characters throughout a number of outputs. Most AI video makers nonetheless lack this means.

5. Keyframe Management

Administrators typically assume when it comes to keyframes, and Ray3 embraces that. By defining a begin and finish body, you’ll be able to let the AI fill within the in-between movement, including a layer of management and predictability to generative video.

6. Brainstorm and Artistic Question

Past video era, Ray3 doubles as an thought associate. Its question system can broaden tough prompts into detailed artistic instructions, stopping artistic blocks.

7. Share & Remix

Each challenge comes with a built-in “behind the scenes” layer. Different creators can see your course of, remix your outputs, and construct collaboratively, making Ray3 as a lot a group software as a manufacturing engine.

8. HDR Era

Ray3 claims to be the world’s first mannequin that is ready to ship studio-grade HDR movies by native excessive dynamic vary coloration era. The AI video software is ready to generate gorgeous HDR movies from textual content prompts, SDR pictures, in addition to SDR movies. What’s extra, it may possibly even export these as 16-bit EXR for seamless integration into professional workflows.

How Does It Work?

Most AI video makers (see the highest 10 right here) generate clips in isolation, however Luma AI Ray3 combines a number of fashions and controls into one pipeline. On the core are two engines working collectively:

• Ray3 (video mannequin): Generates movement sequences, interprets prompts, and handles transitions between frames.
• Photon (picture mannequin): Produces high-quality stills, references, and beginning factors that may move instantly into video creation.
• Right here’s how the method unfolds once you use Ray3:
• Prompting or Referencing: You start with both a textual content immediate (“make it anime”) or a visible reference (a picture, a mode, or a personality).
• Scene Era: Photon generates the stills, whereas Ray3 animates them into clean movement, making use of lighting, textures, and digicam results.
• Keyframe Path: If you happen to present a begin and finish body, Ray3 fills within the in-betweens, simulating how a director would plan pictures.
• Edits and Modifications: You’ll be able to iterate immediately utilizing pure language, from model swaps to environmental adjustments, with out touching conventional modifying software program.
• Collaboration Layer: Your outputs and processes could be shared, remixed, or prolonged by different creators on the platform.

How you can Entry Luma AI Ray3

In the intervening time, Dream Machine is obtainable on each the online and iOS. Ray3, nonetheless, appears to be in a trial mode at current on each.

Ray3 AI Video Maker: Arms-on

We tried the Ray3 for a novel video round a mystical theme utilizing the next immediate:

Generate a sweeping cinematic sequence of a lone wanderer – a tall, cloaked determine with glowing amber eyes – crossing an infinite ocean of clouds on a floating obsidian bridge. Every step sends faint ripples of sunshine by the bridge, as if it’s alive. The digicam glides outward to disclose colossal celestial beings carved of residing starlight, suspended within the sky like historic guardians.

Their silhouettes stretch throughout the heavens, topped with halos of orbiting moons. Because the traveler strikes ahead, the beings slowly flip their heads, illuminating the trail with cascades of golden cosmic fireplace.

The traveler stops on the fringe of the bridge, cloak billowing, because the scene erupts in a symphony of auroras, taking pictures stars, and resonant cosmic hums.The temper is epic, surreal, and awe-inspiring – a visible marvel that blends fantasy, sci-fi, and dreamlike fable.

Right here is the output that the AI software generated:

As you’ll be able to see, the video is sort of distinctive when it comes to high quality. It managed to ascertain a complete new situation as talked about within the immediate, and got here up with fairly a nuanced and correct video accordingly. It even tried to include the finer particulars inside the immediate, just like the lighting on the ft of the determine as he walks on the bridge, in addition to his amber purple eyes.

Having stated that, I can see some inconsistencies within the video too. Among the objects on the far finish are randomly altering shapes all through the video, whereas the celestial beings proven are performing completely random acts. Even the hooded determine is strolling a bit unusually, along with his arm completely disappearing from imaginative and prescient after some extent.

Ray3 AI Video Maker: My Expertise

I attempted a number of different movies too, utilizing easy textual content era prompts in addition to some with reference pictures. Whereas Ray3 is ready to catch the final objective of the video fairly effectively, it principally tends to fail within the nuances of issues and the finer particulars. A video of a fighter jet flying over Noida, as an illustration, turned out a completely bizarre output. The complete shot was shaky, and the jet modified form halfway by the video. Identical with a video of an Indian father-son duo enjoying billiards (pool). The balls on the pool desk appeared to look out of mid-air after which disappear simply as abruptly.

I did some analysis on how Luma Labs greatest suggests using Ray3. As per the corporate, the mannequin works greatest with “quick, pure language, easy prompts. Whereas Ray3 tries to be as correct as potential to the immediate given, it’s most snug with easy and shorter prompts which can be extremely particular. This additionally means the mannequin is best suited to movies round objects and environments which have been envisioned earlier than. Give it one thing completely distinctive and tends to fumble in the dead of night.

The place it shines is the only of animations round a reference picture. Merely add the picture you need to animate, and it offers you a high-quality video output, across the identical, even with out the necessity for a immediate. Living proof, for those who add a picture of a canine, it’s going to animate it with the canine shaking its head or wagging its tail. No immediate wanted. In case there are adjustments, you’ll be able to then point out the identical by follow-up prompts, and Ray3 will get these carried out too. Fairly simple, and really useful.

Conclusion

Whereas Ray3 is spectacular, I really feel it nonetheless has an extended technique to go as a super AI video maker. The listing of latest options it now provides is, little question, extraordinarily useful. Animating a picture, including a keyframe, and even modifying a video utilizing pure language or visible cues are gamechangers in some ways. As is its means to give you HDR movies within the paid model.

However to name it an ideal AI video era software, there’s going to be some time in that.