Artificial intelligence creates textual animations

Artificial intelligence creates textual animations

Disney and Rutgers’ system is far from perfection AI system will help artists visualize their ideas easier. There are now neural networks that create original video on the text description. Although they can not completely replace operators, progress in this area is obvious.

Disney Research and Rutgers have developed a neural network that can create rough scenarios and videos based on text descriptions, says VentureBeat. The system works with a natural language that will enable it to be used in a number of areas, such as creating video tutorials.

In addition, the AI ​​system will help writers visualize their ideas. His creators argue that the goal is not artificial intelligence that would replace writers and artists, but to make their work more effective and less boring. Programmers say that translating text into animation is not an easy task, since input and output data do not have a fixed structure.

Most operating systems can not cope with complex sentences. To overcome the limitations of previous similar programs, developers have built a neural network of several components – the natural language module, the script analysis module, and the animation generation module.

First, the system analyzes text and translates complex sentences into simple. 3D animation is then created. A library of 52 animated system management blocks was used, whose list is now expanded to 92.

Creating an animation is done using the Unreal Engine, which relies on pre-installed objects and models – the system selects the appropriate elements and shapes the video. For system training, researchers have compiled a set of descriptions of 996 elements taken over from over 1000 scenarios with IMSDb, SimplyScripts, and ScriptORama5.

Then, qualitative tests were conducted, in which 22 participants rated 20 animations. At the same time, 68% of the participants point out that the system creates a fairly decent animation based on input texts.

The team, however, admits that the system is not perfect. His list of works and objects is not exhaustive and sometimes lexical simplification leads to inadequate animations. Researchers intend to remove these shortcomings in their further work.

Artificial intelligence creates textual animations