How to Review

Reviewing Labels is an essential step in the process of training data management to ensure only the highest quality data is going to train your machine learning model. Without reviewing the quality of your labeled data, you risk letting poor annotations slip through the cracks which can degrade the performance of your model.

Entering Review Mode

Reviewing labels starts from the Label browser. From here you can view all label activity and enter Review Mode by clicking on the desired label to review.

Modifying a label

Modifying/editing an existing label in Review Mode is the same environment as the labeling environment. You simply click on the label you want to review and the labeling environment will be available to make any necessary improvements to the annotations.

Choosing which labels to review

There are different ways to prioritize which labels to review. You can filter the labels in the Activity tab based on who the labeler is, which dataset the labels came from, or based on the Consensus score.

Delete & requeue

You can choose to delete a submitted labele and put it back in the labeling queue by selecting the “three dots” and then selecting Delete & requeue.

Copy Label

You can choose to copy a label to share with another labeler by selecting the “three dots” and then selecting Copy Link.

How did we do?