# Guides & Exams Creating large and diverse computer vision datasets requires working with a huge labeling workforce. That, in turn, requires professional tools to educate and examine them. Why do we need **Labeling Guides** and **Labeling Exams**? Let's consider several important observations: * Usually, an annotator has concrete **domain specialization**: self-driving cars, agriculture, satellite imagery, medicine, and so on * Not every annotator **properly understands** labeling requirements, thus sometimes they make **systematic errors** during labeling * It is a good idea to choose for your custom task the most efficient and accurate labelers based on **Quality Score** * From labelers perspective, comprehensive annotation policy should be presented as **easy to learn guides and materials** * From time to time company changes annotation policy, all labelers have to be **notified and re-examined** **Labeling Guides** and [**Labeling Exams**](https://ecosystem.supervisely.com/apps/exams) in Supervisely are designed to handle all these aspects. ## Labeling Guides **Labeling Guides** are videos, documents and markdown posts. You can pin here your annotation policy, examples of good and bad labeling and so on. **Labeling Guides** can later be attached to Labeling Jobs and Exams.

## Labeling Exams We recommend using exams via the new [app in Ecosystem](https://ecosystem.supervisely.com/apps/exams). It has new features, improvements, and can be customized by request. Measure how labelers understand task. A manager sees the table with exams and their general information. The row can be expanded and the internal table with all labelers' attempts will be displayed. That table contains **Quality Scores** and links to **Exam Reports**.

This view allows to see the big picture and monitor the entire examination process. Also, it helps to dig into details and see how every labeler performs. ### Exam Report Detailed error analysis at your fingertips. There are several tables with **geometry score**, **objects count score** and **tags score** to calculate more complete **Quality Score**. Also, there is a report table for every image with a bunch of statistics and calculated visual differences.

### Notifications for managers and reviewers Notifications allow you to don't miss relevant information and stay informed of what's going on.

--- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.supervisely.com/collaboration/exams.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.