Contra: AI Image Model Evaluator

Salary: Not specified

Location: San Francisco, CA. Remote or hybrid options available.

Are you a creative professional with a passion for AI technology? Are you looking for an exciting new opportunity to shape the future of image generation models? Look no further! Contra Labs is seeking talented individuals to join our team as AI Image Model Evaluators. This is your chance to be at the forefront of the intersection between human creativity and AI.

At Contra Labs, we partner with top AI labs and product companies to improve their creative tools, from image generation to design, video, and beyond. Our research is grounded in the study of top creatives, understanding the patterns behind what gets created, chosen, and resonates. We believe that human input will always be the driving force behind net new creation, and our mission is to amplify human creativity through shaping technology.

Role

As an AI Image Model Evaluator, you will be responsible for benchmarking the next generation of AI image generation models. While current industry benchmarks focus on surface-level metrics, such as single-turn output quality and prompt adherence, we believe that what truly matters to users is whether the model helped them achieve their desired image. This project is about defining a new standard for evaluating AI image models, one that reflects real creative workflows.

Responsibilities

• Work through a set of creative scenarios using AI image generation models, refining outputs across multiple turns
• Compare outputs of different models, selecting preferences and providing confidence ratings
• Provide clear and structured qualitative feedback on the strength of outputs
• Give specific and concrete creative direction to models through iterative editing
• Help define what "helpfulness" means in a multi-turn creative context

Requirements

We're looking for someone with:

• Experience in creative fields such as illustration, brand design, graphic design, concept art, or visual effects
• A strong eye for image quality, composition, lighting, color, and style
• Comfort working with AI image generation tools and iterating through multiple rounds of edits
• Ability to articulate creative feedback clearly, with specific and concrete direction
• Experience in creative AI workflows is a plus

At Contra Labs, we value diversity and believe that a diverse team leads to better ideas and results. We welcome applicants from all backgrounds and identities.

Apply here: http://bit.ly/3kLhMdk