Media

Cognitive3D can record gaze on both 360 video, 360 images as well as 2D videos and photos in your scenes.

Note

The Media feature is receiving limited support on the dashboard at this time. If you need to use this feature, please get in touch

Setup

To allow the SDK to record gaze hits on media, you need to follow these simple steps:

• Export and Upload your scene using the normal export process (the Open Project Setup from the Cognitive3D menu)
• Open the Feature Builder and click on Media Analytics, then click the Open Media Dashboard button to access the Media Library Manager page
• Press Upload New Media and select the media file you want
• In the Unreal Editor, open the Project Settings and enable Support UV From Hit Results
• Find the surface you chose to play your media on, and use the Add Media Component button in the Feature Builder to add the Media Component to it.
• The Media Component also adds with it a Dynamic Object attached to the mesh on the actor that will be playing your media. Make sure to upload it using our Dynamic Object Manager in the Feature Builder
• From the Media Component details panel, use the dropdown menu to select the desired media that was uploaded to the dashboard earlier.

When you complete the setup, you should now be able to set up points of interest and monitor the gaze hits on your media from the dashboard.

Media Sample Setup

Included with the Cognitive3D SDK content is the MediaSample map. This map has a 360 dome with a platform for the player in the middle of it. You can use this to learn how the 360 Media feature is set up and test it yourself. You can find this map under the Cognitive3D Content maps folder.

Alongside the Maps folder is a Media folder with a few assets.

To use the Media Sample level in your project, with your editor open, move the Maps and Media folders from the Cognitive3D Plugin Contents folder into your project's Content folder in the Content Browser, then open the MediaSample map and follow these steps.

Open the C3D_Sample asset and click the three dots to browse your files and select your video asset. Make sure it is the same one you want to track on the dashboard.

Next, open the C3D_Sample_Player and double-click on C3D_Sample in the File Media Source list.

Since the Media Texture material is already on the 360 dome, your video should be good to go.

Next, you will open the Feature Builder and select Media Analytics. Then, select the 360Dome asset in the scene, and press the Add Media Component button in the Feature Builder.

Finally, use the Full Project Setup Window to export and upload this scene so you can see the results of the gaze data.

If you have a question or any feedback about our documentation please use the Intercom button (purple circle) in the lower right corner of any web page or join our Discord.