Fox worked on the project with Silver Spoon, a real-time animation and virtual production studio. Silver Spoon scanned in all the ballparks and fans so their motions sitting and standing could be properly rendered.
The fans can do up to 500 actions, ranging from high fives during a home run to doing the wave. The system is also advanced where it can control the percentage of fans in the stadium during a game as well as who they are cheering for.
For example, Saturday's Brewers-Cubs game could create a crowd that is 75% Cubs and 25% Brewers. It can also make it appear as if most of them have left if it is a 9-1 ballgame in the ninth inning.
The system will also be able to adapt to the weather. When the temperature gets colder in the fall, winter jackets and hats can be added to the fans.
Major League Soccer is using virtual ads and scoreboards to show fans during its MLS is Back tournament in Orlando, but only one camera is able to show that. Fox will have four of its 10 cameras that it will use for baseball games calibrated to show the virtual crowds. Zager said more may be calibrated as the season goes along.
Zager added that Fox will enhance the crowd noise in addition to what MLB is supplying in the park. He also said discussions are ongoing with the National Football League about crowd noise and virtual fans since there haven't been any final decisions.
“I'm loving it more and more as we progressed through each version,” Shanks said. “This has really dialed in the accuracy of the fans to make it imperceptible on the wide shots to real fans.”
___