AboutAPI ReferenceSDK ReferenceSupport

Multiview

Overview

Import format for multiview video projects in Supervisely. Videos are grouped by datasets - all videos within one dataset form a synchronized multiview group.

Format description

Supported video formats: .mp4, .avi, .mov, .webm, .wmv, .3gp, .flv, .mkv, .mpeg, .mpg With annotations: Yes Grouped by: Datasets (each dataset = one multiview group)

Key Features

  • Videos are grouped by datasets

  • Optional annotations in Supervisely video format

  • Optional metadata files for keeping video frame offset information

How to Use

Prepare structure:

Example data: download ⬇️

  • Archive zip, tar, tar.xz, tar.gz

    📦 archive.zip
 ┗ 📂 project_name
    ┣ 📂 dataset_01
    ┃  ┣ 📂 video
    ┃  ┃  ┣ 🎥 camera_front.mp4
    ┃  ┃  ┣ 🎥 camera_left.mp4
    ┃  ┃  ┗ 🎥 camera_right.mp4
    ┃  ┣ 📂 ann (optional)
    ┃  ┃  ┣ 📄 camera_front.mp4.json
    ┃  ┃  ┣ 📄 camera_left.mp4.json
    ┃  ┃  ┗ 📄 camera_right.mp4.json
    ┃  ┗ 📂 metadata (optional)
    ┃     ┣ 📄 camera_front.mp4.meta.json
    ┃     ┣ 📄 camera_left.mp4.meta.json
    ┃     ┗ 📄 camera_right.mp4.meta.json
    ┣ 📂 dataset_02
    ┃  ┣ 📂 video
    ┃  ┃  ┗ ...
    ┃  ┣ 📂 ann (optional)
    ┃  ┃  ┗ ...
    ┃  ┗ 📂 metadata (optional)
    ┃     ┗ ...
    ┗ 📄 meta.json (optional)

  • Folder

    📂 project_name
 ┣ 📂 dataset_01
 ┃  ┣ 📂 video
 ┃  ┃  ┣ 🎥 video_001.mp4
 ┃  ┃  ┣ 🎥 video_002.mp4
 ┃  ┃  ┗ 🎥 video_003.mp4
 ┃  ┣ 📂 ann (optional)
 ┃  ┃  ┣ 📄 video_001.mp4.json
 ┃  ┃  ┣ 📄 video_002.mp4.json
 ┃  ┃  ┗ 📄 video_003.mp4.json
 ┃  ┗ 📂 metadata (optional)
 ┃     ┣ 📄 video_001.mp4.meta.json
 ┃     ┣ 📄 video_002.mp4.meta.json
 ┃     ┗ 📄 video_003.mp4.meta.json
 ┗ 📄 meta.json

Structure explained:

  • Inside project directory can be one or multiple dataset directories

  • Each dataset = one multiview group: All videos within the same dataset will be displayed together

  • Each dataset directory can contain:

  • video/ - directory with video files

  • ann/ - (optional) directory with annotations in Supervisely format

  • metadata/ - (optional) directory with video metadata files

  • Annotation file names pattern: {video_name}.{video_ext}.json

  • Metadata file names pattern: {video_name}.{video_ext}.meta.json

Meta explained

Required setting for the project to import as multiview. Also shown only lines of interest.

{
  "projectSettings": {
    "multiView": {
      "enabled": true,
      "tagName": null,
      "tagId": null,
      "isSynced": false
    },
    "labelingInterface": "multi_view"
  }
}

Annotation explained

This format uses the standard Supervisely video annotation format. Check the documentation for more details.

{
  "objects": [
    {
      "key": "object_key_1",
      "classTitle": "Car",
      "tags": []
    }
  ]
}

Metadata explained

Optional JSON file with custom video information:

{
  "offsetType": "frame",
  "offsetValue": 5,
  "videoStreamIndex": 0
}

offsetType - type of offset, can be frame or time (ms) offsetValue - offset value in frames or milliseconds videoStreamIndex - index of the video stream in the multiview group (starting from 0)

Can contain offset value, video stream index and offset type.

Useful links

PreviousSuperviselyNextPointclouds

Last updated