Supervisely
AboutAPI ReferenceSDK Reference
  • 🤖What's Supervisely
  • 🚀Ecosystem of Supervisely Apps
  • 💡FAQ
  • 📌Getting started
    • How to import
    • How to annotate
    • How to invite team members
    • How to connect agents
    • How to train models
  • 🔁Import and Export
    • Import
      • Overview
      • Import using Web UI
      • Supported annotation formats
        • Images
          • 🤖Supervisely JSON
          • 🤖Supervisely Blob
          • COCO
          • Yolo
          • Pascal VOC
          • Cityscapes
          • Images with PNG masks
          • Links from CSV, TXT and TSV
          • PDF files to images
          • Multiview images
          • Multispectral images
          • Medical 2D images
          • LabelMe
          • LabelStudio
          • Fisheye
          • High Color Depth
        • Videos
          • Supervisely
        • Pointclouds
          • Supervisely
          • .PCD, .PLY, .LAS, .LAZ pointclouds
          • Lyft
          • nuScenes
          • KITTI 3D
        • Pointcloud Episodes
          • Supervisely
          • .PCD, .PLY, .LAS, .LAZ pointclouds
          • Lyft
          • nuScenes
          • KITTI 360
        • Volumes
          • Supervisely
          • .NRRD, .DCM volumes
          • NIfTI
      • Import sample dataset
      • Import into an existing dataset
      • Import using Team Files
      • Import from Cloud
      • Import using API & SDK
      • Import using agent
    • Migrations
      • Roboflow to Supervisely
      • Labelbox to Supervisely
      • V7 to Supervisely
      • CVAT to Supervisely
    • Export
  • 📂Data Organization
    • Core concepts
    • MLOps Workflow
    • Projects
      • Datasets
      • Definitions
      • Collections
    • Team Files
    • Disk usage & Cleanup
    • Quality Assurance & Statistics
      • Practical applications of statistics
    • Operations with Data
      • Data Filtration
        • How to use advanced filters
      • Pipelines
      • Augmentations
      • Splitting data
      • Converting data
        • Convert to COCO
        • Convert to YOLO
        • Convert to Pascal VOC
    • Data Commander
      • Clone Project Meta
  • 📝Labeling
    • Labeling Toolboxes
      • Images
      • Videos 2.0
      • Videos 3.0
      • 3D Point Clouds
      • DICOM
      • Multiview images
      • Fisheye
    • Labeling Tools
      • Navigation & Selection Tools
      • Point Tool
      • Bounding Box (Rectangle) Tool
      • Polyline Tool
      • Polygon Tool
      • Brush Tool
      • Mask Pen Tool
      • Smart Tool
      • Graph (Keypoints) Tool
      • Frame-based tagging
    • Labeling Jobs
      • Labeling Queues
      • Labeling Consensus
      • Labeling Statistics
    • Labeling with AI-Assistance
  • 🤝Collaboration
    • Admin panel
      • Users management
      • Teams management
      • Server disk usage
      • Server trash bin
      • Server cleanup
      • Server stats and errors
    • Teams & workspaces
    • Members
    • Issues
    • Guides & exams
    • Activity log
    • Sharing
  • 🖥️Agents
    • Installation
      • Linux
      • Windows
      • AMI AWS
      • Kubernetes
    • How agents work
    • Restart and delete agents
    • Status and monitoring
    • Storage and cleanup
    • Integration with Docker
  • 🔮Neural Networks
    • Overview
    • Inference & Deployment
      • Overview
      • Supervisely Serving Apps
      • Deploy & Predict with Supervisely SDK
      • Using trained models outside of Supervisely
    • Model Evaluation Benchmark
      • Object Detection
      • Instance Segmentation
      • Semantic Segmentation
      • Custom Benchmark Integration
    • Custom Model Integration
      • Overview
      • Custom Inference
      • Custom Training
    • Legacy
      • Starting with Neural Networks
      • Train custom Neural Networks
      • Run pre-trained models
  • 👔Enterprise Edition
    • Get Supervisely
      • Installation
      • Post-installation
      • Upgrade
      • License Update
    • Kubernetes
      • Overview
      • Installation
      • Connect cluster
    • Advanced Tuning
      • HTTPS
      • Remote Storage
      • Single Sign-On (SSO)
      • CDN
      • Notifications
      • Moving Instance
      • Generating Troubleshoot Archive
      • Storage Cleanup
      • Private Apps
      • Data Folder
      • Firewall
      • HTTP Proxy
      • Offline usage
      • Multi-disk usage
      • Managed Postgres
      • Scalability Tuning
  • 🔧Customization and Integration
    • Supervisely .JSON Format
      • Project Structure
      • Project Meta: Classes, Tags, Settings
      • Tags
      • Objects
      • Single-Image Annotation
      • Single-Video Annotation
      • Point Cloud Episodes
      • Volumes Annotation
    • Developer Portal
    • SDK
    • API
  • 💡Resources
    • Changelog
    • GitHub
    • Blog
    • Ecosystem
Powered by GitBook
On this page
  • Manual storage cleanup
  • Automatic storage cleanup
  • Manual agent cleanup
  • Automatic agent cleanup
  • Troubleshoot
  • Clean docker images and volumes
  • Clean agent caches

Was this helpful?

  1. Enterprise Edition
  2. Advanced Tuning

Storage Cleanup

PreviousGenerating Troubleshoot ArchiveNextPrivate Apps

Last updated 1 year ago

Was this helpful?

Supervisely has a built-in mechanism to keep your server clean from unused files, but, sometimes, it is not enough. Here are a few notes on how you can clean your instance from files you don't need.

Manual storage cleanup

To remove projects or models you don't need anymore, please use page. Do not forget to visit Server Cleanup page as an admin to provide a final confirmation to permanently remove those files from the storage.

Automatic storage cleanup

Once a day we automatically remove generated archive files for downloading and temporary files created during import. Additionally, we prune old docker images. You can alter how often to perform this cleanup by changing those variables in the .env file:

CLEANUP_STORAGE_INTERVAL=1 day
CLEANUP_STORAGE_TMP_IMPORT_UNTIL=24h
CLEANUP_STORAGE_ARCHIVES_UNTIL=3 days
CLEANUP_DOCKER_INTERVAL=1 day
CLEANUP_DOCKER_UNTIL=24h

Manual agent cleanup

At the Cluster section for each agent you can monitor storage in real time. You will find there a few buttons that clean agent cache.

Automatic agent cleanup

There is no automatic agent cleanup at this moment.

Troubleshoot

Usually, a combination of manual and automatic cleanup procedures keep your instance from bloating, but, if for some reason you can see that occupied disk space keeps growing or you have run into a situation when you have zero free drive space on a system disk and cannot use web interface, check the following folders and run cleanup commands below.

We suggest installing ncdu command if possible and use it as sudo ncdu <folder> or use sudo du -sh <folder>.

Clean docker images and volumes

Bloated folder: /var/lib/docker/

Solution: Stop Supervisely via sudo supervisely rm -vfs. Run sudo docker system prune -a --volumes. Run Supervisely back again via sudo supervisely up -d.

Clean agent caches

Bloated folder: ~/.supervisely-agent/<agent-token>/

Solution: Run sudo rm -rf ~/.supervisely-agent/<agent-token>/*. This will clean up agents' cache. Please note that this would also remove neural network weights checkpoints obtained during training that were not uploaded to the storage.

👔
Disk Usage