Skip to main content
Shaping Europe’s digital future

MUSE: Bringing text to life through 3D story telling

  • NEWS ARTICLE
  • Publicação 24 Agosto 2015

Reading through page after page of dry text may seem like a challenge, especially for children. But what if computers could understand a text and convert it automatically into actions, characters, situations, plots and objects illustrated in a 3D virtual world, which will allow the readers to interact with the story? This is the vision of MUSE (Machine Understanding for interactive StorytElling) project. It introduces a new way of exploring and understanding information by bringing texts to life and developing an innovative text-to-virtual-world translation system.

The MUSE tool was primarily targeted for sectors such as the video game industry and publishers of e-learning tools, to help simplify their development processes. But the software could also have tremendous impact on schools, making the teaching and learning environment more impactful and effective. For example, MUSE can help when children learn to read. The visualizations could be adapted to the reading level of the child. The tool can help in learning to make inferences when reading and understanding a text. In addition it could provide assistance in text understanding and remembering content and its relationships (e.g. when studying a text about science or biology). 

MUSE can also aid citizens in understanding procedures or regulations to be followed, as shown in a demonstration video featured on the project's website. A conversion from a patient manual to a video game enables readers to walk around a hospital and get familiar with the admission process.

The project is in the process of building several demonstrators and in evaluating the technology with real users. The language technologies will be used in a Belgian spin-off and there are already talks with a start-up company.

MUSE will be part of the exhibition at ICT 2015 from 20 – 22 October 2015 in Lisbon and can be found at booth T20 in the Transform area

MUSE in the ICT 2015 catalogue

Project website

Interview with the project coordinator (available also in DE, ES, FR, IT, PL)

ICT 2015 - Lisbon - 20-22 October 2015