Ara Zeta - AI Safety Evaluator – Tamil (Singapore)
Posted 25 days ago
Job Description
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Project Overview
We are seeking experienced bilingual evaluators to support a multilingual AI safety project focused on evaluating model responses across culturally specific prompt-image datasets.
This project involves applying a structured safety rubric to assess AI-generated responses for appropriateness, safety, and reliability within the target locale’s cultural context.
Each language stream will process approximately 1,000 prompt-image pairs. Every item will receive two independent evaluations, with arbitration applied in cases of disagreement. Evaluations will primarily be documented in English, with a defined in-language sample.
Project Details
Location: Remote – Singapore
Team: Welo Data – AI Services
Engagement Type: Freelance – Remote
Start Date:
Duration: 2-3 weeks
Weekly Commitment: 20–40 hours per week
Schedule Options:
• 4 hours per day, Monday–Friday
OR
• 2 hours per day, Monday–Friday + 10 weekend hours
Hourly rate: 28 USD
Responsibilities
- Evaluate AI-generated responses using a structured safety rubric
- Complete two independent evaluations per item
- Provide concise, well-structured rationales in English
- Participate in calibration sessions
- Support arbitration when evaluation discrepancies occur
- Maintain quality and throughput targets during the evaluation window
Qualifications
- Fluency in the target language and English
- Deep cultural understanding of the target locale
- Strong written English skills for documentation and rationales
- Prior experience in safety evaluation, policy review, content moderation, or rubric-based assessment preferred
- Ability to apply detailed guidelines consistently
- Strong analytical skills and attention to nuance
- Reliable availability during the production window
- Priority may be given to contributors who previously worked on prompt-image or similar evaluation projects to reduce onboarding time and maintain continuity.
Disclaimer: This role involves working with explicit and sensitive content. Applicants should be comfortable working with adult material in a professional capacity. Please apply only if you fully understand and are prepared for the nature of this role.
Project Overview
We are seeking experienced bilingual evaluators to support a multilingual AI safety project focused on evaluating model responses across culturally specific prompt-image datasets.
This project involves applying a structured safety rubric to assess AI-generated responses for appropriateness, safety, and reliability within the target locale’s cultural context.
Each language stream will process approximately 1,000 prompt-image pairs. Every item will receive two independent evaluations, with arbitration applied in cases of disagreement. Evaluations will primarily be documented in English, with a defined in-language sample.
Project Details
Location: Remote – Singapore
Team: Welo Data – AI Services
Engagement Type: Freelance – Remote
Start Date:
Duration: 2-3 weeks
Weekly Commitment: 20–40 hours per week
Schedule Options:
• 4 hours per day, Monday–Friday
OR
• 2 hours per day, Monday–Friday + 10 weekend hours
Hourly rate: 28 USD
Responsibilities
- Evaluate AI-generated responses using a structured safety rubric
- Complete two independent evaluations per item
- Provide concise, well-structured rationales in English
- Participate in calibration sessions
- Support arbitration when evaluation discrepancies occur
- Maintain quality and throughput targets during the evaluation window
Qualifications
- Fluency in the target language and English
- Deep cultural understanding of the target locale
- Strong written English skills for documentation and rationales
- Prior experience in safety evaluation, policy review, content moderation, or rubric-based assessment preferred
- Ability to apply detailed guidelines consistently
- Strong analytical skills and attention to nuance
- Reliable availability during the production window
- Priority may be given to contributors who previously worked on prompt-image or similar evaluation projects to reduce onboarding time and maintain continuity.
Disclaimer: This role involves working with explicit and sensitive content. Applicants should be comfortable working with adult material in a professional capacity. Please apply only if you fully understand and are prepared for the nature of this role.
Why Join Welo Data?
✨ Limitless Flexibility
Project-based opportunities that fit your availability. Choose when and how much you want to contribute—fully remote, with complete autonomy.
🌱 Limitless Growth
Optional access to AI and Large Language Model workshops designed specifically for professionals like you. No coding required—just your expertise.
🌍 Limitless Support
Be part of a global contributor community with responsive guidance and support.
💡 Real Impact
Apply your expertise in the Legal field to influence the AI systems shaping the future of your industry—while collaborating with data professionals and expanding your skills.
How to Apply?
Apply now by answering a few quick questions to join our database and become part of our growing community.
About Welo Data
Welo Data, part of Welocalize, is a global AI data company with 500,000+ contributors delivering high-quality, ethical data to train the world’s most advanced AI systems. We’re building smarter, more human AI with a diverse community in 100+ countries.
At Welo Data, Limitless AI. Limitless You. isn’t just a slogan—it’s our promise. We build smarter AI through the power of human contribution, offering limitless opportunities for our global community to grow, contribute, and work on their terms.
Welo Data works with technology companies to provide datasets that are high-quality, ethically sourced, relevant, diverse, and scalable to supercharge their AI models. As a Welocalize brand, WeloData leverages over 25 years of experience in partnering with the world’s most innovative companies and brings together a curated global community of over 500,000 AI training and domain experts to offer services that span:
ANNOTATION & LABELLING: Transcription, summarization, image and video classification and labeling.
ENHANCING LLMs: Prompt engineering, SFT, RLHF, red teaming and adversarial model training, model output ranking.
DATA COLLECTION & GENERATION: From institutional languages to remote field audio collection.
RELEVANCE & INTENT: Culturally nuanced and aware, ranking, relevance, and evaluation to train models for search, ads, and LLM output.
Want to join our Welo Data team? We bring practical, applied AI expertise to projects. We have both strong academic experience and a deep working knowledge of state-of-the-art AI tools, frameworks, and best practices. Help us elevate our clients' Data at Welo Data.
Welocalize
8 jobs posted
About the job
Similar Jobs
6d
German Language Specialist (Pixel Device) - Freelance AI Trainer Project
Invisible
Remote$6 - $65German Language Specialist (Pixel Device) - Freelance AI Trainer Project
Invisible
Remote$6 - $656d5d
German Language Specialist (Android Device) - Freelance AI Trainer Project
Invisible
$6 - $65AustraliaGerman Language Specialist (Android Device) - Freelance AI Trainer Project
Invisible
$6 - $65Australia5d18d
AI Tutor - Software Engineer Specialist
xAI
Remote$60 - $100AI Tutor - Software Engineer Specialist
xAI
Remote$60 - $10018d27d
Investment Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $65Investment Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $6527d27d
Religion Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $65Religion Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $6527d27d
Literature Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $65Literature Specialist – Freelance AI Trainer Project
Invisible
Remote$6 - $6527d27d
Japanese Speaker - Freelance AI Trainer Project
Invisible
$8 - $65United StatesJapanese Speaker - Freelance AI Trainer Project
Invisible
$8 - $65United States27d27d
Japanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65CanadaJapanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65Canada27d27d
Japanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65BrazilJapanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65Brazil27d27d
Japanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65ThailandJapanese Translator - Freelance AI Trainer Project
Invisible
$8 - $65Thailand27d
Looking for something different?
Browse all AI jobsFree AI job alerts
Get the latest AI jobs delivered to your inbox every week. Free, no spam.