- General FAQ
- What is Labelbox?
- Does Labelbox only sell labeling services?
- How do I create a Labelbox account?
- How do I set up a labeling project?
- What kind of data can I label with Labelbox?
- How do people use the labels they create in Labelbox?
- Do I need to be a data scientist to use Labelbox?
- What is the difference between the new Image Editor, the Legacy Image Editor, and the Custom Editor?
- Billing & pricing FAQ
- Labeling workforce FAQ
- Support FAQ
- Quality assurance FAQ
- Technical FAQ
- Importing & exporting data FAQ
- Accessibility FAQ
- Privacy & security FAQ
What is Labelbox?
Labelbox is the industry-leading labeling and training data management platform.
Does Labelbox only sell labeling services?
In addition to labeling services, Labelbox offers:
- An image labeling platform that is user-friendly, open-source, and customizable.
- Extensive collaboration management tools.
- Quality and performance management tools.
How do I create a Labelbox account?
You can sign up at https://app.labelbox.com/signin.
How do I set up a labeling project?
Once you have created a Labelbox account, read How to create a project to set up a project.
What kind of data can I label with Labelbox?
You have the option to use our out-of-the-box labeling application or create your own customized interface to label your data. To see the image formats we support in our Labelbox web application, see Data import overview. If you have need for labeling other file formats, such as text, videos, tiled maps, etc, you can learn about creating a custom editor by reading Custom editor overview and the other articles in that section.
How do people use the labels they create in Labelbox?
In most cases, Labelbox is used by individuals, organizations, and companies in need of high-quality training data to develop and deploy robust machine learning models. People choose Labelbox to create training data for various applications, ranging from independent, small-scale projects to enterprise-scale applications that leverage artificial intelligence to gain a competitive edge.
Do I need to be a data scientist to use Labelbox?
You do not need to be a data scientist to label data in the Labelbox application. We designed our user-friendly platform to require minimal technical knowledge and expertise such that anyone can annotate data using our out-of-the-box web application. However, it may be beneficial to have someone experienced in data science on your team to help ensure that your machine learning project is successfully developed and deployed. If you are interested in developing a custom labeling interface, it would also be beneficial to have someone who is technically capable to configure it.
What is the difference between the new Image Editor, the Legacy Image Editor, and the Custom Editor?
When you create a project, you have the option to choose from the following label editor configurations: Image Editor, Image Editor (legacy), and Custom Editor.
Image Editor — also referred to as the “new image editor”, “Pictor”, or the "segmentation editor" — is the most recent version of the Labelbox label editor released at the end of 2019. This latest version provides more flexibility for creating semantic segmentation & vector-based annotations. If you signed up for Labelbox after November 12th, 2019, you are using the new Image Editor.
Image Editor (legacy) — also referred to as the “legacy image editor”, "v4", or the “object detection editor” — is the previous version of the label editor. We are in the process of migrating functionalities from Image Editor (legacy) to the new Image Editor. The following functionalities will be supported in the new Image Editor in early 2020:
Tiled Imagery is only supported in Image Editor (legacy).
Billing & pricing FAQ
How much does Labelbox cost?
For organizations building expert artificial intelligence systems, we offer Pro & Enterprise licenses. For smaller projects, we offer a Developer license which is free for evaluation, individuals, and small projects with a limit of 2500 labels per year. Check out https://labelbox.com/pricing for more information on the Developer, Pro, and Enterprise license options.
Does Labelbox have a discount for nonprofit organizations or academic users?
How much does your workforce cost?
Labeling workforce FAQ
Can I outsource a team to label my data?
If you would like to outsource a workforce to label your data in Labelbox, you have two options:
- Opt into using our Labelbox workforce when you sign up for a Pro or Enterprise account.
- Find a third party workforce and train them how to use Labelbox.
Can I still use Labelbox If I already have a labeling team?
Yes. Whether your labeling team is outsourced, internal, or both, Labelbox allows your labelers to annotate data while giving you the tools to measure their label quality and performance. If needed, you have the ability combine the efforts of your internal team and an outsourced labeling workforce on the same projects.
Does Labelbox provide support?
Labelbox provides support to all Labelbox users. We have dedicated machine learning support engineers based in San Francisco from 9am - 5pm PST. However, you are welcome to send us a support request outside of these hours and one of our support engineers will respond at their earliest availability. Enterprise accounts will receive a dedicated account manager for additional support as included in the contract. The best way to reach our support team is via the chat feature at the bottom right corner of the we page. You can also email us at firstname.lastname@example.org.
Quality assurance FAQ
What is the difference between consensus and benchmark?
The Auto consensus tool is allows you to compare one the label of one member against the labels of other members to automatically calculate the overall consensus. You can configure the percentage of your dataset in a project that will be selected to be labeled more than once by distinct members. Because this calculation compares a labelers work to that of their peers, you can see which labelers are producing labels that tend not to agree with the majority. You can also track the consensus of your labeled dataset against entire labeling team to ensure high label quality. Poor consensus may also be an indicator for a need to clarify the ontology or classification questions in order to boost the consensus scores.
The Benchmark tool allows you to set a “gold standard” annotation and compare your labelers annotations against it. The benchmark tool works by interspersing data to be labeled, for which there is a benchmark label, to each person labeling. The accuracy score for each label is calculated based on its comparison to its respective benchmark.
Will other labelers see the data that I’m labeling?
If Auto Consensus is turned on and configured, yes. Otherwise, no.
Can I compare model-assisted predictions against human-made labels?
With Labelbox you can connect your machine learning model and compare your model’s performance against your team of labelers. To learn how to import model predictions to your project, click here.
Does Labelbox have an API?
Yes. All of the functionality offered in our application interface can also be programmatically configured with our GraphQL API. Access to the Labelbox API is included in the Pro and Enterprise tiers.
Labelbox also offers a Python API for those wishing to work with the API by using Python instead of by writing GraphQL queries.
If you are interested in learning more about API access and functionality, please contact sales at https://labelbox.com/sales.
How do I create an API key?
API Keys can only be created by Organization administrators. To read our documentation for setting up API keys, click here.
Importing & exporting data FAQ
I already have training data. Can I import it into Labelbox?
Whether you are uploading model-assisted predictions or human-labeled data, you can import your data with the “Import predictions” function of our API. To explore this functionality, please visit our docs page here.
Which label export formats does Labelbox support?
Your labeled data can be exported in JSON or CSV format, which should allow you to import it into any standard machine learning framework. Labelbox does not offer any direct export options for COCO or PASCAL VOC. Users may use the conversion scripts in this open source package to convert a JSON format to COCO or VOC format, however, the scripts in that open source package are no longer being actively maintained by Labelbox.
Does Labelbox work with on-premises data?
Labelbox works with source data hosted on-premises or on a private cloud. The source data is accessed directly from the client computer and is never shared by (or accessible to) Labelbox. Check out our on-premises documentation here.
Does Labelbox work with Cloud buckets data such as Amazon S3 or Google Cloud Storage?
Yes. To learn how to upload your data from these cloud sources, read through our documentation here.
Can I import images from my smartphone?
Notably (but not exclusively), photos taken with smartphones have orientation stored as an EXIF tag in the image’s metadata. However, Labelbox does not read this EXIF tag and will render the image in its original, unrotated state. You may upload photos from a smartphone if you use an image editor to save your image in the correct orientation.
Does Labelbox work in all countries?
Yes, unless your network has a restrictive firewall or you have internet connectivity issues. We currently only support the English language on our platform.
Do I need internet connection to use labelbox?
You must have internet connection to use Labelbox. We recommend either Google Chrome or Firefox as a web browser. Due to known compatibility issues, we do not recommend Internet Explorer or Safari.
What happens if I lose internet connection while I am labeling? Will I lose all the work that I've completed?
Your work will be saved as long as you have internet connection. In the event that you lose internet connection, a message will appear on your screen notifying you that your internet connection is compromised. If this happens, make sure your connection is restored before you continue working to ensure that your work is saved.
Can I use Labelbox on a mobile device or iPad?
We do not support mobile browsers so using Labelbox on a mobile device or iPad will not work.
Privacy & security FAQ
How is data stored at rest?
Data is encrypted at rest using AES256.
What do we do with customer data?
We use each customer’s data to provide the services to that customer. We also use aggregated anonymized data that cannot be traced to any customer individually to improve our products and services.
How is data secured when outsourcing to the workforce?
The outsourced labeling team connects directly to a Labelbox project to label and review, but cannot access the data (including training data) directly. In addition, the workforce providers are Labelbox consultants bound by strict confidentiality provisions regarding your data.
What is the security practice of the labeling workforce?
Our Labelbox annotation services delivery center is SOC2 Type1 certified. All the work is done in a supervised environment by annotators who are employed by Labelbox’s labeling services consulting company. We don’t crowdsource and don’t work with any freelancers. We also don’t allow any remote logins from home.