Skip to content
Jobport

Business Analyst: Non-US Raters

Weekday AI · India 🇮🇳

RemoteContractMid levelData & AI

This role is for one of our clients

We are seeking detail-oriented and analytical Business Analysts – Non-US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, applying predefined evaluation criteria, conducting structured assessments, and delivering accurate, well-documented judgments.

Candidates should have strong analytical skills, business analysis experience, attention to detail, and the ability to work independently in a remote, fast-paced environment. This opportunity is suitable for professionals interested in contributing to AI evaluation and improving the quality, relevance, and reliability of AI-generated responses.

Job Details

  • Role: Business Analyst – Non-US Raters
  • Experience: 3+ years
  • Employment Type: Short-term contract
  • Contract Duration: 16 weeks
  • Location: Argentina, Peru, Mexico, Brazil, Chile, Colombia, India, and Pakistan
  • Compensation: USD 15 per hour
  • Start Date: Immediate
  • Work Mode: Fully remote
  • Availability: Full-time commitment of 8 hours per day
  • Time Zone Requirement: Minimum 4 hours of overlap with the US Pacific Time (PST) time zone
  • Work Schedule: Five working days per week, including weekends when required, with two weekdays off

Requirements

Key Responsibilities

  • Review, analyze, and compare responses generated by multiple AI chatbots against predefined evaluation criteria.
  • Conduct structured assessments to determine the accuracy, relevance, completeness, clarity, and overall quality of chatbot responses.
  • Analyze business requirements and translate them into clear evaluation guidelines and functional specifications.
  • Gather, interpret, and document relevant information to support consistent and objective assessments.
  • Examine workflows, processes, and data to identify gaps, inconsistencies, and opportunities for improvement.
  • Prepare evaluation reports, summaries, and supporting documentation with a strong focus on accuracy.
  • Collaborate with project managers and cross-functional teams to clarify requirements and resolve evaluation-related questions.
  • Track task progress, quality metrics, and project deliverables while meeting established deadlines.
  • Identify recurring response-quality issues and provide actionable observations based on the defined assessment framework.
  • Maintain consistency, confidentiality, and high-quality standards throughout the evaluation process.

Required Qualifications and Skills

  • Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
  • At least 3 years of experience as a Business Analyst or in a similar analytical role.
  • Strong analytical thinking, problem-solving, and decision-making abilities.
  • Excellent written communication skills and the ability to explain findings clearly.
  • Strong attention to detail and the ability to assess information objectively.
  • Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or comparable analytical tools.
  • Experience with requirement gathering, process mapping, and business documentation.
  • Ability to work independently, manage multiple priorities, and meet strict deadlines.
  • Strong documentation skills and the ability to follow structured evaluation guidelines.
  • Familiarity with Agile or Scrum methodologies is an advantage.
  • Willingness to commit to a full-time, 16-week remote engagement with the required time-zone overlap.

Engagement Benefits

  • Opportunity to contribute to projects focused on AI evaluation and response quality.
  • Fully remote work arrangement with the flexibility of working from your location.
  • Exposure to structured AI assessment workflows and quality evaluation processes.
  • Opportunity to contribute to projects with international reach.
  • Clearly defined contract duration, hourly compensation, and evaluation responsibilities.

    Important Engagement Details

    • This is a project-based contract lasting 16 weeks.
    • Work will consist of evaluating multiple chatbot responses and submitting a final assessment for each assigned task.
    • Candidates must be available for 8 hours per day, five days per week, with four hours of overlap with US Pacific Time.
    • The schedule may include weekend work, with two weekdays off each week.
    • Candidates are expected to maintain consistent evaluation quality, follow project guidelines, and complete assigned tasks within the required timelines.

    Posted 19 Oct 2026 (19 Oct 2026) · Source: Weekday AI via Workable

    Similar jobs in India

    Bosch Group · hosur road bangalore, , India 🇮🇳

    On-siteFull-time

    Company Description Bosch Global Software Technologies Private Limited is a 100% owned subsidiary of Robert Bosch GmbH, one of the world's leading global supplier of technology and services, offering end-to-end Engineering, IT and Business Solutions. With over 27,000+ associates,

    8h ago · Bosch via SmartRecruiters

    Eurofins · Bengaluru, KA, India 🇮🇳

    HybridFull-time

    Company Description Eurofins Scientific  is an international life sciences company, providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, healthier and more sustainable. From the food you eat, t

    8h ago · Eurofins via SmartRecruiters

    Eurofins · Bengaluru, KA, India 🇮🇳

    HybridFull-time

    Company Description Eurofins Scientific  is an international life sciences company, providing a unique range of analytical testing services to clients across multiple industries, to make life and our environment safer, healthier and more sustainable. From the food you eat, t

    8h ago · Eurofins via SmartRecruiters

    Capco · India - Pune 🇮🇳

    On-siteFull-time

    About Us “Capco, a Wipro company, is a global technology and management consulting firm. Awarded with Consultancy of the year in the British Bank Award and has been ranked Top 100 Best Companies for Women in India 2022 by Avtar & Seramount. With our presence across 32 cities acro

    10h ago · Capco via Greenhouse