Capture Studio

Capture Studio is a next-generation high-precision facial capture software launched by FACEGOOD, primarily targeting enterprise-level, large-scale, multi-actor facial capture scenarios, providing motion capture teams with 24/7 uninterrupted, stable, wireless, multi-channel, real-time, recording, and motion capture-triggered facial capture capabilities.

Capture Studio

Paired with the FACEGOOD Stereo-HMC P2 binocular hardware system, this hardware system adopts the SmartUnit edge computing architecture, separating computation from control, enabling Capture Studio to be installed on any desktop computer running Windows, significantly lowering the software installation threshold. Meanwhile, based on the SmartUnit architecture, the P2 hardware system reduces the number of spare parts by 50% compared to the previous generation P1 system, making it easier to maintain and use. The SmartUnit edge computing architecture of the P2 provides ample computing power for motion capture teams, allowing for an unlimited number of synchronized actors. Capture Studio's real-time facial capture capability is outstanding, with built-in SeattleAI technology supporting real-time facial capture for actors of any ethnicity and age group, directly driving 660 blend shapes and 820 bone points of metahuman binding, with an accuracy 20 times that of ARKit. Additionally, motion capture teams can conduct AI training for their own binding systems to achieve higher precision in the end.

Note:

① Capture Studio software only supports the FACEGOOD Stereo-HMC P2 binocular hardware system at the moment. Other HMC devices cannot be controlled using Capture Studio.

② The camera of P2 is a 920nm infrared camera, which can block indoor lighting sources. However, outdoor infrared sources may interfere with the camera's operation, potentially causing overexposure in backlit conditions.

Quick Intro

Log in to Capture Studio

• Open Capture Studio and enter your account credentials to log in at the login screen.

File:08c4eebf-b817-4e8d-a583-6d67739119cb.jpg

Open Capture Studio and enter your account credentials to log in at the login screen.

Search for SmartUnit and join

• Upon opening Capture Studio, it will automatically search for SmartUnits within the same local area network. If there are SmartUnits not detected, you can manually search by right-clicking in a blank area and selecting "Search."

• Right-click on the SmartUnit you want to use and select "Connect."

• File:Image.png
• File:Image (1).png

Adjust the camera parameters

• Click on the "Eye Button" in the display area to show the camera feed.

File:Image (2).png

• Click on the "settings button" in the bottom left corner of the screen to adjust recording information.

palceholder ...

Adjust helmet wearing

• When wearing the helmet, remove glasses and ensure hair does not cover the eyebrows. If the screen is blurry, check for any dirt obstructing the lens. With the P2 helmet, adjust the focus by twisting the lens direction.
• Adjustment criteria:
  1. Ensure the actor's facial features are clear and unobstructed.
  2. Align the center of the nose with the center of the camera.
  3. Maintain clear focus without overexposure or underexposure.

     File:Download image.png

Record and download

• Start/stop recording (recorded content will be saved in SmartUnit).

  File:Image (3).png

• The download interface will display all video files from connected SmartUnits.

• After setting the download location, click "Download."

File:Image (4).png

Calibrate Headset

overview

Capture Studio provides two methods, screenshot and ruler, to calibrate the position of the helmet. These methods ensure maximum consistency in the helmet's position during each recording. Typically, helmet calibration is used for facial expression library solving and custom training projects.

Usage Instructions

Snapshot

• Please right-click on the screen and select "Snapshot," then click "Console" to view the location where the screenshot is saved.
• When you need to record again, load the previously saved actor's screenshot so the software can quickly and accurately locate the position of the helmet from the previous session, thus improving work efficiency.
• After loading the screenshot, the previous helmet position will be displayed as a ghost image on the screen. At this point, align the positions of the sides of the nose and try to align the corners of the eyes and mouth with the ghost image as much as possible.
• It's important to note that different helmets may have different lens settings. Therefore, after changing the helmet, it may not be possible to adjust to the exact same angle as the previous helmet.

• File:Image (5).png
• 
• File:Image (6).png

Ruler

• Our software supports dragging out annotation lines, allowing you to quickly and accurately locate the previous position of the helmet.

• Right-click on the screen and select "Show face rule" to enable this feature. Once enabled, simply drag out the annotation lines from the left or top of the screen to use them.

• File:Select ruler.png
• File:Show ruler.png

Audio & Timecode Device

placehoder

Motion Capture Trigger

overview

• Within the same VLAN, the motion capture device triggers the facial capture recording, enabling synchronized recording of motion capture and facial capture. The naming convention for synchronized recording files is as follows:

FG_{performer name}{device name}{motion trigger name}_{current time}.mov

Currently supported motion capture devices

• Optitrack

• Vicon

• Xsense

• PeelCapture

How to use

• In Capture Studio, check the motion capture trigger option and select the corresponding motion capture device. Set the signal port to match the one on the motion capture.
• On the motion capture software, set the same port number as well.
• Set the file name on the motion capture software.

Optitrack settings

1. set to local IP address or Loop mode.
2. Enable Remote Trigger.
3. The DataPort number matches the port number in Streamer (default value: 1511).
4. Set different CommandPort values (1510, 1511, 1512, 1513...) for testing.

Vicon setting

1. Enable Triggered Capture.
2. Set the same port number.
3. Enable recording at the motion capture.

Troubleshooting if can not trigger

Test the network connectivity between two computers.

1. In the command window
   • To view the IP address of a specific PC, open the Command Prompt and type "ipconfig" in the command line.
   • On the Command Prompt of the other computer, type "ping 192.168.x.x" to check if the two computers can ping each other successfully.
2. Disable the firewall to make sure the connection.
3. Check if there are multiple network adapters, which might be causing connectivity issues.

SocketTool trigger test

Test Tool, Download.

1. Create a UDP Client.
2. Set the IP address to the one that needs to be triggered.
3. The port number is the same as the port number in the Streamer settings.
4. Local port settings (default).
5. Set the port number and Streamer port number to be the same.
6. In the sending window, enter the script for trigger testing.
   • Vicon remote trigger script.
   • OptiTrack remote trigger script.
7. If the trigger is successfully activated, then it indicates an issue with the motion capture software's setting.

FAQ

• Does Capture Studio support regular webcam recording or other devices?

Capture Studio only supports the FACEGOOD Stereo-HMC P2 system at the moment. Other systems cannot be controlled using Capture Studio for now.

• What video formats does Capture Studio output?

The videos recorded with the P2 system are saved in MOV format.

• Capture Studio supports a maximum of how many hardware devices to record simultaneously?

Based on the number of subscriptions purchased by the user, a specified number of synchronous recording capabilities will be provided.

• Does it support motion capture synchronized triggering?

YES. Capture Studio natively supports synchronous triggering for Xsens, Optitrack, and Vicon, eliminating the need to purchase third-party motion capture software. Additionally, Capture Studio is compatible with third-party motion capture triggering software such as PeelCapture.

• Dark image of the P2 recording?

Adjust the brightness and contrast settings within Capture Studio to maintain the principle of keeping the face bright while keeping the surroundings darker.