Supervisely
AboutAPI ReferenceSDK Reference
  • 🤖What's Supervisely
  • 🚀Ecosystem of Supervisely Apps
  • 💡FAQ
  • 📌Getting started
    • How to import
    • How to annotate
    • How to invite team members
    • How to connect agents
    • How to train models
  • 🔁Import and Export
    • Import
      • Overview
      • Import using Web UI
      • Supported annotation formats
        • Images
          • 🤖Supervisely JSON
          • 🤖Supervisely Blob
          • COCO
          • Yolo
          • Pascal VOC
          • Cityscapes
          • Images with PNG masks
          • Links from CSV, TXT and TSV
          • PDF files to images
          • Multiview images
          • Multispectral images
          • Medical 2D images
          • LabelMe
          • LabelStudio
          • Fisheye
          • High Color Depth
        • Videos
          • Supervisely
        • Pointclouds
          • Supervisely
          • .PCD, .PLY, .LAS, .LAZ pointclouds
          • Lyft
          • nuScenes
          • KITTI 3D
        • Pointcloud Episodes
          • Supervisely
          • .PCD, .PLY, .LAS, .LAZ pointclouds
          • Lyft
          • nuScenes
          • KITTI 360
        • Volumes
          • Supervisely
          • .NRRD, .DCM volumes
          • NIfTI
      • Import sample dataset
      • Import into an existing dataset
      • Import using Team Files
      • Import from Cloud
      • Import using API & SDK
      • Import using agent
    • Migrations
      • Roboflow to Supervisely
      • Labelbox to Supervisely
      • V7 to Supervisely
      • CVAT to Supervisely
    • Export
  • 📂Data Organization
    • Core concepts
    • MLOps Workflow
    • Projects
      • Datasets
      • Definitions
      • Collections
    • Team Files
    • Disk usage & Cleanup
    • Quality Assurance & Statistics
      • Practical applications of statistics
    • Operations with Data
      • Data Filtration
        • How to use advanced filters
      • Pipelines
      • Augmentations
      • Splitting data
      • Converting data
        • Convert to COCO
        • Convert to YOLO
        • Convert to Pascal VOC
    • Data Commander
      • Clone Project Meta
  • 📝Labeling
    • Labeling Toolboxes
      • Images
      • Videos 2.0
      • Videos 3.0
      • 3D Point Clouds
      • DICOM
      • Multiview images
      • Fisheye
    • Labeling Tools
      • Navigation & Selection Tools
      • Point Tool
      • Bounding Box (Rectangle) Tool
      • Polyline Tool
      • Polygon Tool
      • Brush Tool
      • Mask Pen Tool
      • Smart Tool
      • Graph (Keypoints) Tool
      • Frame-based tagging
    • Labeling Jobs
      • Labeling Queues
      • Labeling Consensus
      • Labeling Statistics
    • Labeling Performance
    • Labeling with AI-Assistance
  • 🤝Collaboration
    • Admin panel
      • Users management
      • Teams management
      • Server disk usage
      • Server trash bin
      • Server cleanup
      • Server stats and errors
    • Teams & workspaces
    • Members
    • Issues
    • Guides & exams
    • Activity log
    • Sharing
  • 🖥️Agents
    • Installation
      • Linux
      • Windows
      • AMI AWS
      • Kubernetes
    • How agents work
    • Restart and delete agents
    • Status and monitoring
    • Storage and cleanup
    • Integration with Docker
  • 🔮Neural Networks
    • Overview
    • Inference & Deployment
      • Overview
      • Supervisely Serving Apps
      • Deploy & Predict with Supervisely SDK
      • Using trained models outside of Supervisely
    • Model Evaluation Benchmark
      • Object Detection
      • Instance Segmentation
      • Semantic Segmentation
      • Custom Benchmark Integration
    • Custom Model Integration
      • Overview
      • Custom Inference
      • Custom Training
    • Legacy
      • Starting with Neural Networks
      • Train custom Neural Networks
      • Run pre-trained models
  • 👔Enterprise Edition
    • Get Supervisely
      • Installation
      • Post-installation
      • Upgrade
      • License Update
    • Kubernetes
      • Overview
      • Installation
      • Connect cluster
    • Advanced Tuning
      • HTTPS
      • Remote Storage
      • Single Sign-On (SSO)
      • CDN
      • Notifications
      • Moving Instance
      • Generating Troubleshoot Archive
      • Storage Cleanup
      • Private Apps
      • Data Folder
      • Firewall
      • HTTP Proxy
      • Offline usage
      • Multi-disk usage
      • Managed Postgres
      • Scalability Tuning
  • 🔧Customization and Integration
    • Supervisely .JSON Format
      • Project Structure
      • Project Meta: Classes, Tags, Settings
      • Tags
      • Objects
      • Single-Image Annotation
      • Single-Video Annotation
      • Point Cloud Episodes
      • Volumes Annotation
    • Developer Portal
    • SDK
    • API
  • 💡Resources
    • Changelog
    • GitHub
    • Blog
    • Ecosystem
Powered by GitBook
On this page
  • 1. Data Version Control
  • 2. MLOps Workflow Visualization
  • 3. Model Benchmarking
  • Building a Workflow
  • Practical Usage
  • Integrating Workflows into Applications:

Was this helpful?

  1. Data Organization

MLOps Workflow

The main features, capabilities and usage recommendations of MLOps Workflow are described in this documentation.

MLOps Workflow streamlines the machine learning lifecycle, focusing on data version control, reproducibility, and collaboration. It provides an easy-to-use visual interface that integrates data management, experiment tracking, and model evaluation.

Why do you need trial tracking and version control?

Data evolution: Datasets change over time, and tracking these changes is critical to maintaining model accuracy.

Avoid confusion: Repeated iterations can lead to errors if teams lose track of which data and model versions were used.

Reproducibility: Proper tracking ensures that results can be reproduced and shared with team.

1. Data Version Control

Data version control simplifies managing changes in datasets throughout the project lifecycle.

Capabilities:

  • Track changes and create backups.

  • Restore previous states with a single click.

  • Centralized tracking of data evolution.

How It Works:

  • Create versions at any stage—data upload, annotation, or transformation.

  • Each version is stored in a secure binary format, avoiding file duplication.

  • Restore data by creating a new project version from a previous state.

Note: Available only on Pro and Enterprise plans.

2. MLOps Workflow Visualization

The visual map shows the entire data lifecycle, including the apps and operations that modify it.

Key Features:

  • Data Operations:

    • Augmentation (cropping, rotation, adding noise, etc.).

    • Annotation transformation.

    • Training data generation.

    • Dataset splitting, merging, and filtering.

  • Navigation: Easily access data versions, projects, and application sessions.

Example:

  1. Data Import: Upload and annotate images using tools like Smart Tool.

  2. Version Creation: Capture the project's state after annotation.

  3. Model Training: Train YOLOv10 while automatically generating checkpoints and reports.

  4. Deployment: Apply the model to new datasets or export results.

3. Model Benchmarking

The platform generates automatic reports to evaluate model performance using metrics such as:

  • mAP, Precision, Recall.

  • Inference speed.

  • Classification accuracy and IoU.

Benefits:

  • Compare model versions to identify improvements.

  • Understand how architecture or hyperparameter changes affect results.

Building a Workflow

Best Practices:

  1. Use Projects Instead of Individual Datasets: This improves Workflow readability.

  2. Optimize Nodes: Combine file cards into folders to reduce redundancy.

  3. Add Descriptions: Provide context for each Workflow element.

  4. Avoid Overwriting Node States: Maintain a clear history of changes.

  5. Organize Session-Based Applications: Prevent clutter and simplify Workflow structure.

Practical Usage

Workflow Entry Points:

  • Project context menu.

  • Task context menu.

  • Workspace options.

Integrating Workflows into Applications:

Detailed instructions for integrating Workflows into your custom applications are available on the Supervisely Developer Portal.

PreviousCore conceptsNextProjects

Last updated 6 months ago

Was this helpful?

📂