About HumanSignal

Real-world data is the competitive edge in AI.

HumanSignal is a human data partner for companies building AI models and products. Our customers ship better AI, faster, because we partner with their researchers from real-world data creation to annotation to delivery.

We design and create datasets from scratch, recruit and manage the domain experts who evaluate model output, and run everything through our own platform, Label Studio, the open-source standard for data labeling and evaluation, used by over 1 million practitioners worldwide.

We specialize in the operationally complex: real-world data collection, multimodal pipelines, and multi-step workflows. Advanced ML and AI teams use our enterprise platform to run their own data factories, and our services team to extend their reach where in-house capacity runs out.

If you want to do work that materially shapes how the next generation of AI products gets built, we’d love to talk.

Graphic Design Expert

Location: Remote

Type: Part-Time Contract (20 hours per week for 4 weeks | 80 hour minimum commitment)

Duration: 4 weeks with potential for ongoing work

Compensation: Up to $25/hour for US-based candidates

About the Project

You’ll examine designs to understand color schemes, font choices, and other design elements. You will then review a slide within that design that seems out of place. Leveraging your graphic design expertise, along with what you learn in our training, you will edit the incorrect slide to match the rest of the overall design. This is all in an effort to train AI models that assess design effectiveness—contributing to cutting-edge technology that advances how AI understands and evaluates visual content quality.

What You’ll Do

• Review designs in Canva Editor to examine various design dimensions:
  • Typography quality (readability, hierarchy, font pairing appropriateness)
  • Visual hierarchy effectiveness (clarity, balance, focal point strength)
  • Design element execution (icon quality, illustration polish, image selection)
  • Color palette effectiveness (harmony, contrast, accessibility)
  • Layout and composition quality (grid usage, spacing, alignment)
  • Overall design effectiveness and professional polish
• Identify flaws in one slide within the overall design. These flaws may be minor, like simple font size issues. They may be major, requiring a full reconstruction of the slide
• Using the other slides in the design as reference, edit the flawed slide to build more cohesion across the entire design
• Process high volumes of design samples with sustained attention to detail
• Meet quality benchmarks for rating consistency and inter-rater reliability

Basic Qualifications

Required Experience

• Formal training in graphic design, visual arts, or related field(degree, certificate, or bootcamp completion) OR 2-3 years of professional graphic design experience
• Fully proficient at intermediate to expert level in Canva Editor
• Strong proficiency in design principles (composition, color theory, typography, visual hierarchy)
• Ability to objectively critique and evaluate design work against industry standards
• Understanding of what constitutes effective vs. ineffective design choices
• Experience reviewing or providing design feedback
• Exceptional attention to detail and ability to maintain focus during repetitive tasks

Skills & Attributes

• Comfort with highly repetitive work—ability to maintain quality and engagement while rating similar content for extended periods
• Strong visual discrimination and consistent aesthetic judgment
• Reliability and consistency in your evaluation standards
• Self-motivated with ability to work independently on repetitive tasks
• Excellent focus and concentration for sustained periods
• Strong communication skills for flagging edge cases or unclear examples
• Comfortable with feedback and re-calibration
• Minimum 20 hours per week availability for at least 4 weeks, with potential to extend

Nice-to-Haves

Preferred Background

• Portfolio demonstrating diverse design work and critical eye
• Experience as a design reviewer, art director, or in quality assurance roles
• Understanding of accessibility standards (WCAG, inclusive design principles)
• Knowledge of design across multiple contexts (branding, editorial, digital, UX/UI)
• Experience teaching or mentoring design concepts

Technical Experience

• Experience with Canva Editor
• Prior data annotation, content moderation, or quality evaluation experience
• Exposure to machine learning or computer vision concepts
• Familiarity with design systems and component libraries

Work Style

• High tolerance for repetitive evaluation tasks—finds rhythm and satisfaction in systematic work
• Ability to maintain consistent standards across thousands of ratings
• Strong pattern recognition—quickly identifying quality patterns across examples
• Disciplined, methodical approach with minimal variation in judgment
• Problem-solving mindset for handling ambiguous or borderline cases
• Interest in AI/ML applications in design and creative fields
• Previous remote work experience with self-directed tasks

What Makes Someone Successful in This Role

You thrive on consistency and repetition- You find satisfaction in systematic work and can maintain quality standards while evaluating similar content repeatedly without losing focus or accuracy.

You have a calibrated design eye- You can quickly assess design quality against objective criteria and apply the same standards consistently across hundreds or thousands of examples.

You’re objective and principled- You separate personal taste from professional assessment, basing ratings on established design principles rather than subjective preference.

You maintain sustained focus- You can work through high volumes of repetitive tasks while staying sharp and attentive to subtle quality differences.

You’re a clear communicator- You flag confusing examples or rating criteria early, ask clarifying questions, and document edge cases clearly.

You’re curious about technology- You’re genuinely interested in how AI learns to evaluate design quality and see value in contributing to machine learning training data.

Job Type: Contract, Part-time

Location: Remote

Role Description

In this hourly, remote contractor role, you will work as a Copywriting & Content Subject Matter Expert (SME) to review AI-generated marketing/content-writing outputs and/or create expert copy and content, evaluating reasoning quality, intent alignment, and step-by-step writing decisions while providing precise written feedback. You will assess solutions for accuracy, clarity, brand fit, tone, and adherence to the prompt; identify issues in logic, messaging, audience targeting, claims/compliance risk, structure, and style; fact-check statements where needed; write high-quality explanations and model outputs that demonstrate strong copywriting technique; and rate and compare multiple responses based on effectiveness, correctness, and reasoning quality. This role is with a fast-growing AI Data Services company delivering training data for many of the world’s largest AI companies and foundation-model labs. Your copywriting expertise directly helps improve the world’s premier AI models by making their writing more persuasive, accurate, on-brand, and clearly explained. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Your Profile

• Bachelor’s degree (or higher) in Communications, Marketing, Journalism, English, or a related field (or equivalent professional experience).
• 5+ years of professional experience in copywriting, content writing, editorial, content marketing, or brand storytelling.
• Strong command of brand voice, tone adaptation, and audience-aware writing (B2B and/or B2C).
• Ability to evaluate and improve writing for clarity, structure, persuasion, and consistency, including headlines, CTAs, and narrative flow.
• Demonstrated ability to spot and correct factual errors, weak reasoning, overclaims, and potential compliance issues (especially in regulated domains).
• Familiarity with common content formats: landing pages, email campaigns, blog posts, ads, social posts, product copy, scripts, and long-form guides.
• Comfort providing specific, actionable feedback and writing gold-standard rewrites with rationale; minimum C1 English proficiency.
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
• Prior experience with AI data training/annotation, content QA, editorial operations, or style-guide governance is strongly preferred.
  
  

Key Responsibilities

• Develop AI Training Content: Create detailed prompts and gold-standard copy/content across multiple formats and industries to guide AI learning.
• Optimize AI Performance: Evaluate and rank AI responses to improve clarity, persuasion, tone match, and factual reliability.
• Ensure Model Integrity: Test AI outputs for inaccuracies, hallucinated claims, bias, unsafe advice, and brand-risk issues; validate reliability across use cases.

Job Type: Contract, Part-time

Location: Remote

Role Description

In this hourly, remote contractor role, you will work as a Copywriting & Content Subject Matter Expert (SME) to review AI-generated marketing/content-writing outputs and/or create expert copy and content, evaluating reasoning quality, intent alignment, and step-by-step writing decisions while providing precise written feedback. You will assess solutions for accuracy, clarity, brand fit, tone, and adherence to the prompt; identify issues in logic, messaging, audience targeting, claims/compliance risk, structure, and style; fact-check statements where needed; write high-quality explanations and model outputs that demonstrate strong copywriting technique; and rate and compare multiple responses based on effectiveness, correctness, and reasoning quality. This role is with a fast-growing AI Data Services company delivering training data for many of the world’s largest AI companies and foundation-model labs. Your copywriting expertise directly helps improve the world’s premier AI models by making their writing more persuasive, accurate, on-brand, and clearly explained. Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Your Profile

• Bachelor’s degree (or higher) in Communications, Marketing, Journalism, English, or a related field (or equivalent professional experience).
• 5+ years of professional experience in copywriting, content writing, editorial, content marketing, or brand storytelling.
• Strong command of brand voice, tone adaptation, and audience-aware writing (B2B and/or B2C).
• Ability to evaluate and improve writing for clarity, structure, persuasion, and consistency, including headlines, CTAs, and narrative flow.
• Demonstrated ability to spot and correct factual errors, weak reasoning, overclaims, and potential compliance issues (especially in regulated domains).
• Familiarity with common content formats: landing pages, email campaigns, blog posts, ads, social posts, product copy, scripts, and long-form guides.
• Comfort providing specific, actionable feedback and writing gold-standard rewrites with rationale; minimum C1 English proficiency.
• Reliable, self-directed, and able to deliver consistent quality in an hourly, remote contractor workflow across time zones.
• Prior experience with AI data training/annotation, content QA, editorial operations, or style-guide governance is strongly preferred.
  
  

Key Responsibilities

• Develop AI Training Content: Create detailed prompts and gold-standard copy/content across multiple formats and industries to guide AI learning.
• Optimize AI Performance: Evaluate and rank AI responses to improve clarity, persuasion, tone match, and factual reliability.
• Ensure Model Integrity: Test AI outputs for inaccuracies, hallucinated claims, bias, unsafe advice, and brand-risk issues; validate reliability across use cases.

About the Company

Terry Soot Management Group (TSMG) is a field data collection company founded in 2017 in Europe.

We collect data where automation is not possible. Our teams support projects involving speech recording, transcription, image and video collection, mapping, and AI training across Europe and North America.

Project Overview

We are looking for detail-oriented participants to join an audio transcription project supporting the development of speech recognition and conversational AI systems.

Participants will listen to recorded audio conversations and accurately transcribe them into text following project guidelines. The work involves understanding spoken language, identifying speech patterns, and ensuring high transcription quality.

This is a remote, flexible project suitable for people with strong listening and language skills.

Responsibilities

• Listen to recorded audio files in the target language
• Transcribe conversations accurately and clearly
• Follow formatting and transcription guidelines
• Review and correct transcription errors when needed
• Complete assigned tasks within the required deadlines
• Maintain confidentiality of project materials

Requirements

• B2 level in English
• B2 level in target language
• Good listening and typing skills
• Strong attention to detail
• Comfortable working with audio and text-based tasks
• Reliable internet connection and computer access
• Able to follow instructions and meet deadlines

Nice to Have

• Previous experience in transcription, annotation, or data labeling
• Familiarity with AI tools or online platforms
• Additional language skills are a plus

What We Offer

• Flexible remote work
• Simple onboarding process
• Opportunity to contribute to AI technology development
• Support from the project team throughout the project
• Performance-based opportunities for future projects

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Please submit your CV in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI...

Please submit your CV in English and indicate your level of English proficiency.Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

Role OverviewJoin a high-selectivity evaluation program focused on reviewing complex written…

Headquarters: San Francisco
URL: http://workada.co

Who We Are

Workada creates high-quality labeled data for advanced technology systems. Our team reviews, organizes, categorizes, evaluates, and quality-checks digital content so those systems can better understand information and perform real-world tasks.
We believe careful data work matters. Every reviewed item, categorized example, and quality-checked task helps improve how technology interprets information, follows instructions, and responds in practical settings.

About You

We're hiring detail-oriented individuals who are comfortable working on a computer and interested in careful, focused digital work. We're especially interested in:

• People who can carefully review written information, images, documents, or other digital content
• Strong readers and writers with good judgment
• People who can follow detailed instructions consistently
• Individuals who are comfortable using web-based tools and online platforms
• People who take quality seriously and can spot mistakes or inconsistencies
• Those who enjoy focused, independent work while contributing to a larger project
• Strong character matters — we value integrity, reliability, curiosity, and a commitment to high-quality work

Qualifications

• Comfortable using a computer for extended periods
• Reliable internet connection
• Strong attention to detail
• Ability to follow written guidelines and project instructions
• Clear written communication skills
• Basic familiarity with spreadsheets, online forms, or web-based work tools
• Ability to work independently and meet deadlines
• Prior experience in data labeling, annotation, quality review, research, writing, customer support, operations, or administrative work is helpful but not required

Compensation

Compensation is $18- $22 an hour and a max of 40 hours a week.

A Place to Do Meaningful Work

Data labeling may sound simple, but it plays an important role in improving the technology people use every day. At Workada, your work helps create the examples and feedback that make advanced systems more accurate, consistent, and useful.

We're looking for people who care about accuracy, consistency, and careful judgment. Whether you're reviewing text, categorizing information, evaluating responses, or checking data quality, your work helps improve the way technology performs.

To apply: https://weworkremotely.com/remote-jobs/workada-data-labeling-specialist-remote-contract-work-18-22-per-hour

Wing Data is looking for Freelance Video Data Contributors to support one of our clients AI training projects through short video-based tasks.

In this role, you will complete 5, 10, or 15-minute video sessions by either responding to prompts individually or taking part in short guided conversations. These recordings will be used to help train and improve our clients AI speech systems.

This is a flexible, project-based opportunity rather than a full-time or monthly position. Work is assigned based on availability, and tasks may range from a single 5-minute session to several hours of work.

Preferred Languages:

• Bengali

• Marathi

• Tamil

• Telugu

• Kannada

• Gujarati

• Punjabi

• Hindi

• Hindi + English -> Hinglish

• Malayalam

Responsibilities

• Complete short video recordings or conversation tasks for AI training purposes.
• Follow clear project instructions to ensure natural, accurate, and usable speech data.
• Join tasks when available; assignments may range from a few minutes to multiple hours.
• Submit recordings through the designated online workflow or platform.

What You’ll Need

• Fluency in the target language ( Bengali, Marathi, Tamil, Telugu, Kannada, Gujarati, Malayalam, Punjabi, Hindi, Hinglish )
• Ability to follow instructions and produce clear voice data consistently in the target language
• A computer with reliable internet access.
• A decent microphone and webcam.
• Legal authorization to work in your country.

What To Expect

• Remote, freelance, task-based work
• Short assignments, usually 5, 10, or 15 minutes.
• Work is offered on an as-available basis, so task volume can vary from a single short session to several hours in a given period.

Compensation

• You will be paid $2 USD - $4 USD Per Hour
• Pay is structured around an hourly rate and prorated by task length.
  • For example: A 5-minute task would pay roughly one-twelfth of the hourly rate.

$2 - $4 an hour

Important: After submitting your application, please complete our short screening form here:

[ https://forms.gle/WDgS64Nvai4RZHaP6 ].

We will ONLY review candidates who complete both the application and the screening form. The form takes about ~2 mins to complete.

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

Please submit your CV in English and indicate your level of English proficiency. Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving...

We are looking for a Book Reviewer to evaluate the accuracy and depth of AI-generated content and provide clear feedback to improve training data quality.

As an AI Trainer - Junior Journalist, you will help train AI models by crafting text that teaches AI reasoning, logic accuracy, nuance, and clarity.

Project OverviewWe are sourcing independent Business Owners across the food, lodging, service, and shopping sectors to provide their practical expertise for an AI benchmark evaluation and product feedback project. As AI models and digital commerce platforms increasingly integrate local business data, search mapping workflows, and automated merchant tools, their accuracy relies entirely on authentic, real-world verification. The objective of this project is to autonomously evaluate merchant-facing features, audit local search representation, and deliver structured feedback to refine AI-driven commerce systems.Project Deliverables & ScopeOperate autonomously to evaluate digital merchant tools and provide structured business data. Expected deliverables include:

Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We’re Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:

• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You’ll Do

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents— break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more.
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements

• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)

Toloka AI supports frontier model post-training by building domain-specific reinforcement learning environments, tasks, and evaluation frameworks designed by real practitioners.

Mindrift, powered by Toloka — a leading enterprise AI and machine learning data partner since 2014 — connects top domain experts with cutting-edge AI initiatives. Backed by Toloka’s deep expertise in scalable data generation, crowd technology, and applied ML systems, Mindrift enables experts to shape how next-generation generative models learn, reason, and perform.

We are launching a Management Consulting domain focused on translating real-world consulting engagements into structured learning environments for advanced AI systems. To do this credibly, we are assembling a team of strategy consultants from top-tier firms who can convert authentic project experience into end-to-end examples — from problem structuring and work planning to analysis, synthesis, and client-ready recommendations.

You will join a growing team of consultants from leading strategy firms shaping how AI learns high-level business reasoning.

Important: This role is exclusively for consultants with direct experience at a top-tier strategy consulting firm. If you do not have hands-on project experience at one of the firms listed below, please do not apply. This requirement ensures the domain is built by practitioners trained to the highest standards of structured problem-solving and client delivery.

Eligible firms: McKinsey & Company, Boston Consulting Group (BCG), Bain & Company, Oliver Wyman, Roland Berger, Monitor Deloitte (Deloitte S&C), EY-Parthenon, Kearney, and Strategy& (PwC).

Who We’re Looking For

Consultants with 3+ years of experience at one of the firms listed above, with hands-on project experience in:

• Structuring ambiguous client problems into workable analytical plans
• Building financial models, market analyses, or synthesized findings from messy inputs
• Producing client-ready deliverables under time pressure
• Forming and defending recommendations under uncertainty

No deep technical background is required — we will onboard you on the lightweight tools involved.

What You’ll Do

• Build realistic consulting project environments — create detailed project scenarios grounded in real engagement dynamics: industry context, financials, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents— break projects into discrete tasks that mirror real consulting work: market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, benchmarking, and more.
• Define evaluation criteria and quality standards — develop grading frameworks, evaluation rubrics, and golden-answer solutions for each task, used to train and calibrate an LLM-based grading system that evaluates AI outputs at scale.

This is a remote, project-based, individual-contributor role focused on analytical design and evaluation.

Skills & Requirements

• 3+ years at McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY-Parthenon, Kearney, or Strategy&
• Strong structured problem-solving and hypothesis-driven thinking
• Ability to translate vague problems into clear analytical steps and deliverables
• High attention to logical consistency and output quality
• Independent, self-directed working style
• Clear written English (B2+)