Meta Brings Users’ Doodles To Life With New AI Collaboration That Generates Animations

Tech giant Meta is officially bringing users’ doodles to life by converting them into real animations.

Facebook’s parent firm confirmed today how it was open-sourcing a new endeavor where anyone and everyone can turn doodles into something more spectacular and innovative in terms of exciting graphics.

The new AI collaboration with Animated Drawings is Meta’s latest open-source offering where developers can create bigger and brighter art experiences.

The team at FAIR ended up releasing web-based tool versions of this in 2021. This is where users are requested to put up drawings of single human-like characters or simply choose a demo figure to include in their task. When you make use of your personal doodles, you get a consent form that asks for permission so Meta can use the drawing to train the AI models it owns. Even if you don’t provide consent, you’re still allowed to use this tool.

Next up, you’ll definitely be resizing capture boxes in a manner that fits so snugly around your particular project. This tool provides users with an eraser and pen combo so the drawing gets tweaked before making adjustments to where a joint should be located. After this, you get to see animated versions of your personalized sketch come to life.

Users are given the chance to select from a wide range of animations that are preset from before. You can simply select from a huge variety of animations through four different categories like dance, jumping, funny, and even walking.

These types of animated drawings harness the best object detection models while posing estimation designs and image processing endeavors in the form of segmentation methods. The goal here is to capture some digital versions of any particular drawing.

It then makes use of classic techniques involving computer graphics that not only deform but animate a particular picture. After a few months of this feature going live as a demo, Meta was given the green light by users to make use of nearly 1.6 million pictures for the sake of training. Some people put up pictures of company logos, anime characters, fish, stuffed animals, and more. This was cool as the tool was designed only to stipulate human figures and nothing else but this was not the case.

Other than requests for an in-depth toolset that includes sound effects and text, there is an array of pictures installed that suggest how there happened to be a big interest in some extensive drawing experiences. This led to Meta getting open-sourced for this project and datasets of nearly 180,000 drawings.

Meta explains that putting out such models and allowing them to be coded as an open source means giving rise to a project that introduces a starting point so developers can build on it and extend it further.

Hence, what this provides is a huge culture of innovation and even collaboration throughout the open-source community.


Read next: How Has Social Media Impacted Users’ Lives? This New Survey Has The Answer
Previous Post Next Post