Virginia Tech creative technology student Jason Hodge carefully adjusted a cluster of sensors on his classmate Matt Finn’s motion capture suit as high-tech cameras tracked their every movement in Newman Library’s Virtual Environments Studio. The duo brought to life “Grey’s Sonata,” a video game they are developing and designing using technology typically reserved for top-tier gaming studios.
“Check this out,” Hodge said.
On-screen, a character sat behind a piano playing tunes inspired by the soundtrack of “La La Land.” In the physical world, Finn sat a desk in a bodysuit covered in small, reflective sensors, moving his hands and fingers to the music’s beat. In an instant, the physical and virtual worlds merged.
Finn stretched his arms, watching as his digital counterpart mirrored his motion on screen. “It’s so cool seeing yourself inside a game,” Finn said. The creative technology major then lifted his arms and wiggled his legs, and the in-game character did the same, down to the subtlest twitch.
“The motion capture equipment available in the studio was an absolute game-changer,” Hodge said. “We used this equipment to track movement onto the models we created for the game’s main characters. Without access to this equipment, it would have been painstakingly difficult to animate frame by frame for each character and movement.”
Industry-level resources
The University Libraries Studios Network houses technology and equipment that most independent developers can only dream of — Hollywood-grade motion capture systems, high-fidelity facial tracking technology, and sophisticated audio recording equipment that captures sound from every angle. These resources allow students like Finn and Hodge to create professional-quality games while still in school, giving them a significant edge as they aspire to enter the gaming industry.
“This technology is expensive, but I get the privilege of having access to it here at Virginia Tech,” Hodge said. “Students at other universities might not have a way to experiment with this technology, so they won’t be able to go into the field knowing how to use this equipment properly. I have an advantage.”
“Grey’s Sonata,” a story of grief and mystery
“Grey’s Sonata” is a physics-based puzzle game where the story unfolds as the player finds clues, solves mysteries, and completes challenges. The narrative centers around a small family living in the Bronx in 1998 grappling with loss and the game explores themes of grief, memory, and healing through interactive storytelling.
“We aim to make a game where the viewer is more of an observer who cannot directly interact with the other characters in the story,” Finn said. “Instead, you guide the other characters throughout the game.”
The duo has dedicated countless hours to refining the game, ensuring that the puzzles challenge players and advance the unfolding story. Players use telekinesis to manipulate objects, explore different portals, and watch revealing cutscenes to solve the game’s intricate riddles.
Blending art and technology
Beyond game mechanics, the artistic direction of “Grey’s Sonata” is also a crucial component of its design. The game’s aesthetic features a hand-painted style, inspired by classic animated films and impressionist artwork. Motion capture technology allows the characters’ movements to feel fluid and lifelike, enhancing the emotional weight of the story.
“Every object in the game follows a color palette that I would hand paint onto the models that we made,” Hodge said. “Our mechanics are based on the player’s input. The player can solve the puzzle in any way they want. They can make it harder for themselves or easier, but some risks have more rewards.”
Leveling up as game developers
As Finn and Hodge push toward completing their project, they are preparing for their next steps after graduation. Both students hope that “Grey’s Sonata” will serve as a strong portfolio piece, showcasing their technical skills and creative vision to potential gaming industry employers.
“This hands-on experience has made me more prepared to enter the professional gaming industry,” Finn said. “We are learning relevant skills such as collaboration while getting to work with important technologies.”
While the team continues refining “Grey’s Sonata,” Finn and Hodge are honing the skills that will define their careers.
“In the professional world, motion capture systems are used heavily to create video games, so already knowing how to use this technology while I’m a student is huge,” said Hodge.
The duo hopes to share their creation with the world this summer, with a planned release on the popular digital game distribution service Steam.
“It’s going to be so fun seeing someone finally play the game that we spent countless hours creating,” Hodge said. “Seeing someone’s reaction to the gameplay will be the best part of the whole process.”
