AI Evaluator (Spanish)

Costa Rica

Full-time

Job Description

About the role:

We are looking for highly skilled AI Evaluators to support the development of advanced AI tools for grammar correction and proofreading. This project focuses on creating a rich and diverse dataset of written Spanish text, annotated and corrected by humans.

Responsibilities:

Respond to a set of prompts simulating realistic business or casual communication.
Write clear, plausible short texts (3–4 sentences for business settings, 1–2 sentences for casual chat).
Generate responses with intentional but realistic grammar, spelling, and structural errors.
Review annotated message pairs (input text + corrected/proofread version) to ensure:

All grammar/spelling/preposition/punctuation errors are corrected appropriately
Meaning is preserved between input and corrected text
Error types are classified correctly
Explanations are clear and linguistically sound

Qualifications:

Spanish as a first language - C2 Spanish proficiency
English as a second language - B2 English proficiency.
Ability to follow linguistic and situational writing prompts.
Good written communication and creativity.
2 years working experience in a corporate/ business environment.
1 year working experience working as an AI Evaluator, data annotator, or similar role
Strong computer literacy and fast, accurate typing skills are essential for navigating annotation tools and maintaining efficiency in text-based tasks.
Strong logic, intuitive problem-solving and critical thinking; adaptability to the needs of the task. The candidate needs to be open-minded and welcome different viewpoints or solutions.
Proactiveness, confidence to work independently without constant support. Reliability and being able to make good decisions on their own.
Be a thought partner to delivery managers, input into the project delivery strategies, and share quality best practices to aid in achieving the project goals.
Adapt quickly to evolving guidelines, new task types, and AI model updates in a fast-paced, iterative environment.
Access to your own laptop for work

Preferred Qualifications:

C1 or C2 English preferred
Experience in GenAI is a plus

About Sama

Sama provides high-quality training data that powers AI technology for Fortune 2000 companies such as Google, Walmart, Ford, Microsoft, and Marriott. We’re experts in data annotation, supporting text, 2D, 3D image, video, and sensor data for machine learning algorithms and generative AI models. Sama offers the highest quality SLAs in the industry, along with cutting-edge ML-assisted annotation tools, QA processes, and security and compliance standards.

Founded in 2008 on the belief that “talent is equally distributed, but opportunity is not”, Sama is driven by the mission to expand opportunities for those who are underprivileged. As a certified B-Corp, Sama has provided worker training programs to increase economic opportunity for more than 15,000 people from underserved communities. By connecting our customers with amazing talent in East Africa, we've impacted more than 69,000 workers and their dependents.

Today, our vision is to provide data scientists, ML engineers, and data operations teams with an indispensable, integrated platform for AI data preparation, labeling, and collection.

For more information, visit www.sama.com.

More information can be found at:

Our Culture:

Sama is quite unique. We are a technology company with a social mission. People that thrive in a high-growth environment, love working on the bleeding edge of technology, and really care about having a positive impact on the world are a great fit for the Sama culture. Our core values are One Team, One Goal - Deliver. Period. - Trust & Transparency - Customer First - Humanity.

Our Benefits:

Sama is proud to offer competitive compensation corresponding to market data & level of experience. Sama also offers benefits packages based on country of employment, including but not limited to medical, dental, vision, and life insurance, holiday and vacation policies, professional development stipends and a paid sabbatical program. Our Talent Acquisition team would be happy to discuss our benefits packages with you in more detail during the interview process.

At Sama, we pride ourselves in being a diverse and equal opportunity employer.

Please mention that you found this job on MoAIJobs, this helps us grow. Thank you!