All guidesHow to use the model Foundry for automated data labeling and enrichment
Foundation models, such as GPT-4, are ushering in a new era of AI by outperforming humans on numerous tasks across modalities including images and language. With the introduction of the Foundry add-on for Labelbox Model, we’re bringing the power of foundation models into the Labelbox platform.
Meet your new AI co-pilot: Foundry
Labelbox Foundry enables AI teams to use world-class foundation models to enrich datasets and automate tasks. In just a few clicks, AI builders can explore, test and integrate powerful models to build vital workflows for pre-labeling, or other specific data tasks. Kickstart your AI efforts with this AI copilot to build intelligent applications faster than ever.
Early tests with Fortune 500 companies show up to 88% reductions in human labeling time, with complex tasks going from days to hours. Foundry integrates these state-of-the-art models into every step of the workflow, unlocking the next evolution of AI development. Kickstart your AI and data labeling efforts with this co-pilot to build intelligent applications faster than ever.
We’re excited to announce that Foundry is available as an add-on for Labelbox Model!
With Foundry, you can:
- Access the world’s most cutting-edge models and combine them with human-in-the-loop systems to accelerate model development.
- Pre-label data in a few clicks to reduce labeling costs by up to 90%.
- Tailor intelligence to your needs using Labelbox’s comprehensive end-to-end platform and workflow in Foundry. From fine-tuning to model distillation, you can customize intelligence beyond pre-built AI.
Foundry works across Labelbox's products — Catalog, Annotate, and Model — to supercharge your labeling and model development.
How to access Foundry:
Free Tier organizations
Foundry is only available to our Starter and Enterprise plans, to access Foundry you will need to:
1) Upgrade your account to our Starter plan:
- In the Billing tab, locate “Starter” in the All Plans list and select “Switch to Plan.” The credit card on file will only be charged when you exceed your existing free 10,000 LBU.
- Upgrades take effect immediately so you'll have access to Foundry right away on the Starter plan. After upgrading, you’ll see the option to activate Foundry for your organization.
2) After upgrading to our Starter plan, please follow the instructions under the Starter plan below to activate Foundry as an add-on for your organization.
Self-serve organizations on a Starter or Standard plan
As part of the self-serve Starter or Standard plan, you automatically have the ability to opt-in to using Foundry.
To generate model predictions, just submit a model run and you’ll be guided to activate Foundry along the way:
1) Generate predictions: Start by selecting data in Catalog and click “Predict with Foundry.” You’ll be able to select a foundation model and submit a model run to generate predictions.
2) Activate Foundry: The first time you submit a model run, you’ll see the option to activate Foundry for your organization’s Admins. You’ll need to agree to Labelbox’s Model Foundry add-on service terms and confirm you understand the associated compute fees.
3) Payment method: With Foundry, you will be charged for the Labelbox units (LBUs) your account consumes, plus any pass-through compute costs for the models you use.
For self-serve Starter and Standard tier to enable billing for these model compute charges, you'll be asked to confirm the credit card on file for your Labelbox account. Alternatively, you may add another card if you prefer to keep the Foundry charges separate. By confirming your payment method, you agree to let Labelbox to bill your card as Foundry model compute fees accrue based on your usage.
Enterprise organizations
As an organization on our Enterprise plan, you automatically have the ability to opt-in to using Foundry.
To generate model predictions, just submit a model run and you’ll be guided to activate Foundry along the way:
1) Generate predictions: Start by selecting data in Catalog and click “Predict with Foundry.” You’ll be able to select a foundation model and submit a model run to generate predictions.
2) Activate Foundry: The first time you submit a model run, you’ll see the option to activate Foundry for your organization’s Admins. You’ll need to agree to Labelbox’s Model Foundry add-on service terms and confirm you understand the associated compute fees.
3) Payment method: With Foundry, you will be charged for the Labelbox units (LBUs) your account consumes, plus any pass-through compute costs for the models you use.
If you are on an annual contract plan, you may add a credit card on file to pay for the associated compute costs of a model or choose to receive a monthly invoice at the end of each month based on your organization’s Foundry usage.
See it in action: How Foundry works
In the below interactive demos, you'll learn how to leverage foundation models to generate model predictions, send predictions as pre-labels to a labeling project in Annotate, and verify the predictions with human-in-the-loop review:
Step 1: How to generate model predictions with Foundry
Access a vast range of ready-to-use foundation models that embed advanced AI into your data tasks with ease. Quickly generate predictions to pre-label datasets or to enrich your existing data to extract better insights that boost productivity and increase time-savings.
Step 2: How to send Foundry predictions as pre-labels to a labeling project
Rather than labeling from scratch, combine the power of foundation models with human-in-the-loop review to accelerate your labeling operations.
Step 3: How to verify pre-labels with human-in-the-loop review
Focus human intelligence on critical quality assurance instead of on initial labeling efforts. Seamlessly validate model-generated pre-labels in Annotate – approving accurate predictions with a click and easily editing or sending incorrect labels to be corrected.
Check out the below tutorials to learn how Foundry can accelerate your pre-labeling and data enrichment workflows in Labelbox.
What use cases is Foundry available for?
Foundry currently supports a variety of tasks for computer vision and natural language processing. This includes:
Computer Vision
- Object detection
- Image classification
- Image segmentation
Watch the below demo to see how to use Foundry for an object detection use case with Amazon Rekognition and Grounding Dino:
This demo uses Amazon Rekognition and Grounding Dino, but you can leverage any other computer vision model available in Foundry.
Natural Language Processing
- Text generation
- Translation
- Question answering
- Zero-shot classification
- Summarization
- Conversational
- Text classification
- Named entity recognition
Watch the below demo to see how to use Foundry for a text classification use case with GPT-4:
This demo uses GPT-4, but you can leverage any other large language model available in Foundry.
How is Foundry priced?
Foundry pricing will be calculated and billed monthly based on the following:
- Inference cost – Labelbox will charge customers for inference costs for all models hosted by Labelbox. Inference costs will be bespoke to each model available in Foundry. The inference price is determined based on vendors or our compute costs – these are published publicly on our website as well as inside the product.
- Labelbox's platform cost – each asset with predictions generated by Foundry will accrue LBUs.
Model LBU is consumed for every data row that goes through Foundry. Annotate LBU is consumed for every data row that has a prediction (from Foundry) submitted as a label.
The unit compute costs are listed on the model card for each model found in the Labelbox app.
Learn more about the pricing of the Foundry add-on for Labelbox Model on our pricing page.
Where can I provide feedback or ask questions?
If you have questions or feedback related to the Foundry workflow, please submit a ticket here.
Additional Resources
To learn more about Foundry and familiarize yourself with the workflow, we recommend checking out the below resources:
- Foundry Documentation
- Demo videos
- Models currently available in Foundry
- Recent blog posts exploring the power of foundation models:
- Explore six of the most powerful foundation models available to AI builders, the use cases and applications they are best suited for. Read now
- GPT-4 offers a versatile toolkit to help enterprises kickstart labeling. Learn how to leverage GPT-4 for your machine learning or specific business use case. Read now
- Many businesses have more specialized and domain-specific use cases. Discover the benefits of incorporating foundation models into your specialized AI application development workflow. Read now
- Removing personally identifiable information from datasets is crucial for teams building AI. Explore how you can extract PII from your datasets with higher accuracy and speed. Read now
