Skip to content
Jobport

Copy of LLM Model Response Evaluation

Lifted, an Upwork Company™ · Ottawa, ON, Canada 🇨🇦

RemoteContractMid levelOther

Skills mentioned

Company Description

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Job Description

 

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.

Qualifications

  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities 

Additional Information

Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly

Posted 6 Aug 2026 (6 Aug 2026) · Source: Lifted Solutions via SmartRecruiters

Similar jobs in Canada

Sopra Steria · Montréal, QC, Canada 🇨🇦

HybridFull-time

Description de l'entreprise CS Group Canada, filiale de CS Group (qui fait partie du groupe Sopra Steria), est un chef de file dans le développement et la certification de systèmes critiques pour la sécurité dans les secteurs de l’aérospatiale, de l’électrique et de la conduite a

3h ago · Sopra Steria via SmartRecruiters

Quiktrak · Saguenay, Quebec, Canada 🇨🇦

On-siteContract

3h ago · Quiktrak via BambooHR

Quiktrak · Dartmouth, Nova Scotia, Canada 🇨🇦

On-siteContract

3h ago · Quiktrak via BambooHR

Quiktrak · Kentville, Nova Scotia, Canada 🇨🇦

On-siteContract

3h ago · Quiktrak via BambooHR