Powered by Information Department Government of Sindh

Collaborating with a leading AI lab to contract experienced professionals for an AI model evaluation project. Contractors will assess the quality, accuracy, and safety of AI-generated responses across specialized domains such as finance, law, medicine, and accounting. The project offers an opportunity to directly improve the reliability of AI systems in high-stakes contexts where inaccurate information carries serious risk.

Key Responsibilities

 

  • Write realistic prompts that reflect how professionals and consumers seek domain-specific guidance
  • Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness
  • Identify fabricated claims, incorrect references, or misleading reasoning across model outputs
  • Score and rank multiple model responses using structured rubrics across dimensions
  • Provide written justifications with specific evidence for each evaluation 

     

Ideal Qualifications

 

  • Master’s degree or higher in a relevant professional field (e.g., Finance, Accounting, Law, Medicine, Healthcare, Engineering)
  • Professional experience applying domain expertise in a practitioner or advisory capacity
  • Familiarity with industry-specific standards, regulations, or clinical guidelines
  • Strong written communication and critical reasoning skills 

     

More About The Opportunity

 

  • Expected commitment: ~20 hours/week

     

Application Process

 

  • Complete the platform application and required screening assessments.
  • Complete a Training Assessment 

     

Contract and Payment Terms

 

  • You will be engaged as an independent contractor.
  • This is a fully remote role that can be completed on your own schedule.
  • Projects can be extended, shortened, or concluded early depending on needs and performance.
  • Payments will be issued according to the payment method and schedule outlined in your contract.

     

Skills: annotation,training,finance,social media,context,accounting,medicine,prompt writing

 

Job search faster with Premium

Access company insights like strategic priorities, headcount trends, and more

Millions of members use Premium

Try Premium for Rs 0

1-month free trial. Cancel with ease. We’ll remind you 7 days before your trial ends.

Salary

Market Competitive

Monthly based

Location

Karachi Division,Pakistan,Pakistan

Job Overview
Job Posted:
3 weeks ago
Job Expire:
5 days from now
Job Type
Pvt Job
Job Role
- Oversee end-to-end eBook project execution (planning to delivery). - Coordinate between writers, designers, editors, and marketing teams.
Education
Bachelor's Degree
Experience
2 Years
Total Vacancies
1
Age requirment
18 Year - 35 Year

Job Tags:

Share This Job:

Location

Karachi Division,Pakistan,Pakistan