This $2,500 Suit Simplifies Motion Capture for Filmmakers

I'm sitting in the back row of The Arena Stage in Hollywood, which is role of the Theatre of Arts School. A large screen is suspended over the stage, only behind two young performers. They're wearing nylon, aviator-way flying suits; cables attached to their heads connect to a hub at the base of their spines.

This is the Smartsuit Pro from Rokoko, a movement capture arrangement company headquartered in Copenhagen, which today announced a partnership with Unity Technologies to provide Unity developers access to Rokoko'southward Smartsuit Pro and its Motion Library via the Unity Asset Store.

"Developing for character animation has historically been super plush and fourth dimension-consuming," Adam Myhill, Creative Director for Made with Unity, told PCMag via e-mail. "Rokoko's Smartsuit Pro and Motion Library...provide creators with the ability to build motion assets every bit if they were using a full-calibration move capture studio, but in a much more affordable, easy, and instant way."

Back at Theatre of Arts, drama students who just finished a combat class enter The Loonshit Stage. Onstage with the performers in Smartsuits is instructor Henry Layton, who trained at the International Stunt Schoolhouse in Seattle, and is now a lead motion-capture stunt performer.

Layton checks the Rokoko Smartsuit Pro connections and asks his students to go into an "A pose" and "T pose" (making an A and T shape with the body) so the software system tin initiate.

Smartsuit Pro from Rokoko

Sitting next to me, in the stalls, is Monica Alderete, VP of Campus Hollywood, the brotherhood of entertainment manufacture schools, to which TOA belongs.

"The students are here today for our brand new motion capture performance class," said Alderete. "Nosotros started it because all our teachers are industry professionals and, when they're out there working, they hear nigh the latest requirements for performers today. Henry Layton told us about this latest sensor-laden performance capture gear, and how, if our students go proficient in this skill, they could proceed to audition for roles on animated video games and movies."

With the deal between Unity Technologies and Rokoko, TOA grads might find themselves booked to stockpile a broad range of motility capture movement, which is then spliced up, categorized, annotated, and used in future animation products.

"Ready, Big Dave?" says Layton, shielding his optics from the spotlights and peering up towards the control box high on the far wall.

"Affirmative," David Mattey, who's operating the Smartsuit Studio, responds over the theater speaker system. "Fix to roll."

"Copy that," Layton replies onstage.

Suddenly, an animated gremlin pops up on the screen backside one of the actors. Whenever she moves, and then does the gremlin; they are fused in performance via the $2,500 suit. But here'southward the clever chip: this accommodate has no "optical sensor" markers (those foreign tennis ball-type stick-ons) like other move capture setups, because there's no photographic camera grid mounted on the ceiling to tape dimensions in space. Instead, the Smartsuit has a wireless range of upwardly to 100 meters. It uses sensors built into the fabric itself, tracks 9 degrees of freedom, establishes a baseline skeleton frame, then records all motion, which can exist reanimated/reskinned into a called character.

This changes everything in the motion capture business organisation—no expensive camera grids to lease, rig upward, and maintain. Instead, a Smartsuit enables the actor to deliver a top operation by communicating wirelessly with the Smartsuit Studio. Once a range of motions and scenes are recorded, the software tin can output to any platform the creator requires, as they develop their movie, game, or blithe project.

Equally the students practiced their moves onstage to get used to the Smartsuits, I joined David Mattey and Henry Layton up in the control box to detect out more.

"Non long later on graduating from the International Stunt School and joining the Society of American Fight Directors, I was booked for my offset job—in Sweden on the outset Chronicles of Riddick," said Layton. "My fight master had been playing the atomic number 82 character and sadly only got injured, then he recommended me.

"I was a kid from Louisiana and all of a sudden I'thou in Sweden—that was middle-opening—and it was the first of it all. The stunt world is pocket-sized, everyone knows each other, and the motion capture world is smaller still. As I say to my students: 'Once producers know you, and you're proficient at your job, you lot're in,'—that's definitely been my experience."

Smartsuit Pro from Rokoko

Today's class was all about pedagogy the students how to work with the Rokoko Smartsuits merely for Layton, information technology was also an opportunity to follow up on R&D calls he'd been having with the team back in Denmark. Rokoko has been using experts similar Layton to "boot the tires" on the applied science so information technology tin iterate and produce what the industry really needs.

"Dave [Mattey] and I have had regular Skype calls with Matias Søndergaard, co-founder and chief product officer, telling them about the stress tests, and hacks, we need them to exercise," Layton said. "Right now, I'yard afraid to suspension the suits, and so we're avoiding falls, but we practise need to go big.

"The first thing I noticed—now I'1000 seeing the suit in action, off my body, because I've been testing information technology while wearing it myself—is that, as actors, we need to exaggerate movements then the suit picks up that performance at the skeleton level, then makes information technology zing inside the character when animated."

Smartsuit Pro from Rokoko

Upward in the control box, I was surprised to encounter Mattey using a Dell Windows x laptop—no massive GPU, no banks of Nvidia machines churning away processing masses of telemetry data.

"Yes, this is all nosotros need now," confirmed Mattey. "The conform communicates with the hub affixed to the body, and then information technology knows where all the performer'south limbs are, and then sends that information, via the router, to the software up here, essentially creating a network that'south non connected to the cyberspace."

No, hackers can't control the performer's Smartsuit remotely, only in case you were wondering about that.

"Right," laughed Mattey. "That can't happen. It's definitely a closed loop."

As the actors onstage ran through some moves, Mattey showed how swiftly the software processes each body shape. "Once we do a T Pose it calibrates with the suit, then this programme tracks movements at 100 frames per 2d," he explained.

So if inspiration strikes you, you're competent on using Unity, and just need a range of animated motions to embed within your characters, bank check out the Unity Nugget Shop before long. You lot never know, those back flips and gangster struts yous purchase might well accept been created by Henry Layton and his performance students at the Theatre of Arts Schoolhouse in Hollywood.