Storytelling with Augmented Reality
At the magical intersection of visual storytelling and digital creativity lies Patrick’s idea transforming static artwork into a completely interactive experience, through augmented reality on any handheld device. He is currently bringing his idea to life, using the Fiddler’s Three collection, telling the story of nursery rhymes through storyboard paintings. An ideal application for this, each painting get its own Story AR, telling the nursery rhyme, with animated frames, in immersive augmented reality.
The viewer can scan the QR code next to art work and tap to activate the free viewer app. Point the device camera at the piece, get the whole image in frame, a “Play” button will appear and watch the story. Below are examples of Story AR in action for two of the children’s stories paintings, currently with no audio, to keep file size small, but would like to add in future versions.
Little Miss Muffet
This triptych tells the story of Miss Muffet, as a ladybug, with the spider scaring her away. While the painting captures key moments, Story AR walks us through the whole nursery rhyme, animated in the style of the painting with the last frame matching.
Using Procreate on the iPad Pro, Patrick digital created the animation in the same visual style as the acyclic painting original, creating a seamless experience for the viewer.
Bah Bah Black Sheep
This one tells the story of Bah Bah Black Sheep having bags of wool and the distribution of that wool. The Story AR version matches the traditional animated style, but he added 3D models and animation of the bags of wool, for testing and integration. Patrick created the bags of wool in Blender and exported the rendered objects and textures. Blender was used for 3D modeling and animation can be done in Blender, Aero or in combination.
Here is the complete Fiddler’s Three collection, (View Slideshow), which will all have Story AR augmented reality experiences for an upcoming show (TBD).
The paintings are all acrylic on stretched canvas. The production for these are done in the Adobe Creative Suite, primarily Photoshop and Aero Beta, with digital drawing and painting done in Procreate on iPad Pro / Pencil. With the basics down, Patrick will be focusing on more 3D animation and green screen video integration, as well as additional AR technology options.