Labelbox•January 28, 2022
ML teams need powerful, intuitive tools to help them identify trends in model performance and uncover edge cases. We’ve made improvements to Model Diagnostics over the past month that give users access to more insightful comparison metrics and support for additional data types. We’ve also expanded model-assisted labeling (MAL) to support video bounding boxes, and are excited to offer MAL to all paid customers.
We’ve introduced the model gallery so you can more easily see all your work in one place. Gallery view shows you when your model was first created as well as how many model runs each model has.
Within an individual model, you can now compare model performance from one model run to the next so you can see where you’ve made the most meaningful improvements. In the example below, you can see how IoU improved for most classes between version 0.0.0 and 0.0.1.
To inspect changes in performance at the asset level, you can now see multiple iterations of model prediction overlaid on a single asset. This lets you see how a new iteration of your model performed in more detail so you can make more informed decisions about the type of data you need to prioritize for labeling to train your next iteration. Here you can see an example of a demo model that erroneously identified the laptop as a cat in version 0.0.0 before correctly identifying it as a laptop in version 0.0.1.
With these updates, you can get much more powerful insight into the performance of your model, helping you quantify and visualize improvements from one iteration to the next.
We’ve expanded Model Diagnostics to now support text classification and tiled imagery. Compare model predictions to ground truth data, view detailed performance metrics, and identify weak spots and outliers in your data so you can guide your next iteration.
Our Model-assisted labeling (MAL) workflow allows you to import computer-generated predictions and load them as pre-labels on an asset.
MAL can make data labeling more effective by reducing overall labeling time and driving down human labeling costs by 50-70%.
MAL for all paid Labelbox customers
MAL for video
Read more about MAL supported data and annotation types in our documentation.
Webhooks let you orchestrate powerful workflows that respond to real time events in Labelbox. With the release of the webhooks UI you can quickly view, create, and deactivate webhooks all through the app, actions that used to only be possible through the SDK. To try out this new feature navigate to your account settings page. To learn more about our webhooks check out or docs.
Open Beta - all plans
Open Beta - Pro plan
Sign up for our Closed Beta