We are looking for skilled researchers to support AI and large language model (LLM) evaluation projects.
This work is ideal for people who are naturally curious, analytical, and skeptical of information at face value. You should enjoy investigating unfamiliar topics, determining whether claims are accurate, finding reliable evidence, and explaining your conclusions clearly.
You do not need previous AI or data annotation experience. Strong research ability, source judgment, analytical reasoning, and written English are more important.
This is a remote, project-based opportunity. Work availability may vary depending on active projects and client demand.
What You'll Do
Depending on the project, you may:
-
Research and verify factual claims using publicly available online sources.
-
Identify authoritative and reliable sources to support or challenge a claim.
-
Cross-reference information across multiple sources.
-
Evaluate the factual accuracy and quality of AI-generated responses.
-
Identify unsupported statements, inconsistencies, reasoning errors, or missing information.
-
Compare AI-generated responses and determine how well they meet defined evaluation criteria.
-
Provide concise written explanations supporting your conclusions.
-
Follow detailed project guidelines and apply evaluation criteria consistently.
-
Document sources and evidence so that research conclusions can be independently verified.
-
Work independently across unfamiliar topics and subject areas.
Who We're Looking For
You may be a strong fit if you have experience in one or more of the following areas:
-
Research or research analysis
-
Fact-checking or source verification
-
Journalism or editorial research
-
OSINT or investigative research
-
Due diligence or background research
-
Competitive or market intelligence
-
Academic research
-
Legal research or paralegal work
-
Information science or library research
-
Trust & Safety investigations
-
AI/LLM evaluation, data annotation, or quality review
Candidates from other professional backgrounds are also encouraged to apply if they can demonstrate strong research and analytical skills.
Required Skills
-
Fluent to near-native professional English proficiency (C1/C2 level or equivalent) is required.
-
Exceptional English reading comprehension, including the ability to interpret nuance, qualifiers, ambiguity, and complex written claims.
-
Ability to write clear, precise, grammatically strong, and evidence-based explanations in English.
-
Ability to distinguish subtle differences in meaning and identify unsupported or misleading statements.
-
English proficiency will be evaluated through a practical research and writing assessment; formal language certification is not required.
-
Strong online research skills.
-
Ability to distinguish authoritative sources from weak or unreliable sources.
-
Ability to verify claims rather than relying on the first available search result.
-
Strong analytical and critical-thinking skills.
-
Ability to compare conflicting information and reach evidence-based conclusions.
-
Clear, concise written communication.
-
Strong attention to detail.
-
Ability to follow complex written instructions and evaluation criteria.
-
Comfort researching topics outside your existing area of expertise.
-
Reliable internet access and ability to work independently in a remote environment.
Preferred Qualifications
The following are helpful but not required:
-
Previous fact-checking, verification, investigative, or research experience in English.
-
Experience working with primary sources, government databases, academic publications, corporate records, or other authoritative information sources.
-
Familiarity with AI-generated content or large language models.
-
Previous experience evaluating AI responses, search results, or digital content.
-
Experience documenting research findings and citing supporting evidence.
What Success Looks Like
Strong contributors are able to take an unfamiliar question or claim and systematically determine:
What exactly needs to be verified?
Where is the strongest evidence?
Is the source reliable and appropriate for the claim?
Do multiple credible sources agree?
Does the available evidence actually support the conclusion?
Can I explain my reasoning clearly and concisely?
Accuracy and evidence matter more than speed alone.
Assessment Process
Qualified applicants may be invited to complete a short online assessment designed to evaluate:
-
Web research ability
-
Fact-checking and source verification
-
Source-quality judgment
-
Analytical reasoning
-
Evaluation of AI-generated responses
-
Written English and ability to explain conclusions
The assessment focuses on practical research and reasoning skills rather than general knowledge.
Engagement
This is a remote, project-based opportunity supporting AI data and evaluation projects.
Project availability, workload, duration, and working hours may vary based on client requirements. Successful qualification does not guarantee a specific volume or duration of work.
Additional project-specific requirements, rates, schedules, and guidelines will be communicated before assignment to an active project.
About TrustScale
TrustScale supports organizations developing and improving AI systems through specialized global talent, data, evaluation, and quality workflows.
We work with professionals around the world who bring language, research, domain, and analytical expertise to complex AI projects.
