Lentil markets itself as a unique take on regular photography, enabling users to infuse their images with styles inspired by legendary animation studios and video game aesthetics. The app’s creator, still studying, conceptualized Lentil as a tool for blending reality with imaginative realms. Describing the app, the developer states, “It’s kind of like your regular camera, but with a twist — it turns your photos into things inspired by universes like Ghibli, Minecraft, Coraline, LEGO sets, and more.”

One of the standout features of the Lentil app is its ability to mix various artistic styles, allowing users to experiment and discover interesting combinations. Moreover, the app cleverly incorporates a lenticular effect, letting users switch between their edited images and the original photo simply by tilting their device. This innovative functionality creates a sense of depth and movement, akin to viewing holographic cards, and serves as a delightful nod to visual arts that have fascinated audiences over the years.

The app’s description on the App Store highlights this feature, stating, “Tilt your phone to see your photo shift between real life and your newly created AI world. Blend your reality with other worlds in seconds.” As an added incentive, Lentil is currently available for free, enabling users to create as many photo transformations as they wish. However, to prevent spamming, the app requires users to register with a phone number prior to access.

While the exact mechanics behind Lentil’s functionality remain somewhat of a mystery, speculation on Reddit suggests that the app leverages an img2img model of the renowned AI image generator Stable Diffusion, with the addition of ControlNet. This speculation highlights a growing interest in the capabilities of AI technology in the creative space, a point of contention for some traditional artists and creators.

Studio Ghibli, one of the most esteemed animation studios globally, serves as a prominent inspiration for the app. Known for its captivating storytelling and exceptional hand-drawn animation, the studio has produced timeless classics such as “My Neighbor Totoro” and “Spirited Away.” Founded in 1985 by Hayao Miyazaki, Isao Takahata, and Toshio Suzuki, Studio Ghibli has consistently charmed audiences of all ages with its imaginative worlds and richly developed characters. However, it’s worth noting that one of the studio’s co-founders, Hayao Miyazaki, expressed concerns over the rise of AI technology in artistic endeavors, responding with dismay when introduced to AI tools in the past year.

In a unique twist, Lentil taps into the nostalgic appeal of lenticular prints, an art form that has seen varying levels of popularity over the decades. Last year, photography enthusiasts also marveled at lenticular print technology through interviews with photographers dedicated to capturing moments in stereoscopic detail, illustrating the enduring allure of this artistic technique. As Lentil continues to generate buzz in the photography and creative communities, its success may pave the way for further innovative applications of AI technology, blending the lines between reality and the imaginative worlds we create.

As users explore the whimsical possibilities offered by Lentil, the app’s potential impact on photography and art as a whole remains to be seen, but one thing is clear: the fusion of AI and photographic creativity could herald a new era of artistic expression.

Traditionally, animating an actor’s performance onto a digital character involves complex and often cumbersome processes, including motion capture technology, intricate rigging setups, and multiple footage references, making it largely accessible only to professional studios. However, Runway has reimagined this process with its mission to democratize creative tools for artists, allowing for expressive and controllable outputs that can expand the pathways for artistic expression.

Act-One eliminates the need for elaborate motion-capture methods, making it possible to translate an actor’s performance into animations featuring a variety of character designs and artistic styles. As Runway explains, the challenge with conventional methods has often been preserving the subtle emotional cues from live footage while translating that onto digital characters. The Act-One model sidesteps these pitfalls by using a unique pipeline focused solely on an actor’s performance, ensuring that the resulting animations remain emotionally authentic and nuanced.

One of the standout features of Act-One is its ability to produce cinematic outputs that maintain high realism across multiple angles and focal lengths. This capability empowers creators to generate emotionally rich character representations while enhancing depth and personality—elements that previous animation technologies struggled to deliver. The model is particularly adept in capturing facial animations, offering robust expression fidelity and ensuring that viewers connect effortlessly with the characters on screen.

Moreover, Act-One can adapt to a wide array of character styles, from playful cartoons to photo-realistic digital humans, effectively harnessing the power of deepfake technology in a constructive manner. With this versatility, creators can experiment with diverse narratives, utilizing only a standard consumer-grade camera and a single performer who can portray multiple roles.

In addition to enhancing visual creativity, Act-One preserves crucial aspects of performance such as eye lines, micro-expressions, pacing, and dialogue delivery in its outputs. This thoughtful adaptation magnifies the emotional impact and connectivity, allowing audiences to forge a genuine bond with the animated characters, regardless of their design.

As Runway rolls out Act-One to its user base, the tool represents a significant milestone in the realm of AI and animation, opening up new frontiers for artists to explore. With its ease of use and expansive potential, Act-One is set to become an indispensable asset for content creators looking to blend live-action performance with digital storytelling. Soon, this innovative technology will be available for widespread use, promising to reshape the future of animation and broaden the horizons for imaginative expression.