Camera Tracking

Create and configure a Tracking System and Physical Camera

XRTracking XRTracking XRTracking XRTracking

PhysicalCamera Icon Physical Camera requires a specific XR/AR license. If you’d like to try out these features to decide whether you want to purchase an XR/AR license, please contact us.

Create a control device

In an XR or AR project, Smode needs to know the position of your camera in real-time. This allows Smode to synchronize the movement of the virtual camera in 3D space, ensuring that the image on the LED screens is consistent from the camera’s perspective.

To obtain real-time information about the camera’s position, you need to use a tracking system.

Ensure that your tracking system is properly configured and calibrated before connecting it with Smode.

To establish a connection between your tracking system and Smode for real-time data retrieval, you must create a Control Device in the Preferences panel panel. Click the Add button to create a new Control Device, and select the type of tracker you are using from the list.

AddControlDevice AddControlDevice

In this example, we will use a Stype Tracking Device.

NewStypeDevice NewStypeDevice

Configure the address and port of the device. If another application needs to access the data of this device, check “Reuse local port”.

Once your device is configured, you should see incoming data in the DevicesWorkspaceComponent Icon Devices Panel :

StypeDatas StypeDatas


Create a tracking System

In the RootStageElement Icon Stage , create a TrackingSystem Icon Tracking System and place it above other stage elements. Select the tracking Control Device you created from the list of devices in the tracking system’s settings.

TrackingSystemDevice TrackingSystemDevice

A Tracker Icon Tracker will be created in your tracking system.

If your tracking system is positioned below other stage elements, you may encounter issues during the calibration process.


Create a physical Camera

Create a PhysicalCamera Icon Physical Camera . It is a specific camera designed to simulate a real one. By default, it’s placement is of the Link To Tracker type.

Select the Tracker Icon Tracker associated with your camera.

PhysicalCameraTracker PhysicalCameraTracker

Place the camera in a GroupStageElement Icon Stage Elements Group and position it in between the tracking system and the LED screens.


Layers order

At this point, all the necessary Stage Elements have been created. To ensure your calibration works, please follow this order of layers:

  • Tracking System
  • Physical Camera
  • Floor LED screen
  • First LED screen wall
  • Second LED screen wall

Example:

  • Correct:

XR-LayerStage-Good01 XR-LayerStage-Good01

  • Correct: the positions of the LED screen walls are interchangeable:

XR-LayerStage-Good02 XR-LayerStage-Good02

  • Not correct: the tracking system isn’t in first position in the tree:

XR-LayerStage-False01 XR-LayerStage-False01

  • Not correct: the Camera isn’t in second position in the tree:

XR-LayerStage-False02 XR-LayerStage-False02

  • Not correct: the Floor isn’t the first LED screen:

XR-LayerStage-False03 XR-LayerStage-False03


You can now proceed to the next step: XR - Broadcasting 3D content on the LED screens .