logo
Leaderboards

Image generation

Last updated: February 10, 2025

Our image generation leaderboard evaluates AI models on their ability to generate high-quality images from textual descriptions. We assess various factors based on the project's specific criteria.

Human preference evaluation

Diverse pool of US-based Alignerrs, including generalists and creative artists

Consensus of three Alignerrs per task

Standardized instructions and ontology for consistent evaluations

Carefully curated prompt generation process, balancing creativity and clarity

Overall preference

Prompt alignment

Visual appeal

Examples

PROMPT

Cinematic: A resolute soldier unlocking a mysterious wooden door in a dimly lit room. Dramatic chiaroscuro lighting highlights tension. Close-up perspective, emphasizing the soldier's anxious but righteous expression.

Imagen 3

DALL·E 3

Flux 1.1 Pro

Stable Diffusion 3

Ideogram 2.0

Recraft v3