Quality Assurance - Search Ops AI Evaluation

About the Team
The Search Operations team aims to improve search user experience, contribute significant DAU impact to the products and drive for increase in traffic and GMV.

The T&S evaluation and investigation team, working closely with the search team, taking the evaluation standards as the baseline and principles, and manually evaluating the search query and the corresponding search results page to reflect the real user experience of the search function.

Responsibilities
-Perform regular audits relating to AI model projects, detect errors and inconsistencies completed by specialists.
-Ensure assessments adhere to evaluation standards and quality guidelines.
-Provide constructive feedback, conduct calibration meetings, analyze team performance, and proactively offer solutions and suggestions to address current problems in order to deliver high-quality performance.
-Localise the policy, be responsible for policy training, and align the policy updates.
-Track and analyze quality metrics to identify trends and recommend improvements.
-Collaborate closely with the Product team and R&D to provide feedback on data quality.
-Willing to work on sensitive issues that include child exploitation, a variety of religious and political views, violence, adult and sexual contents.
-Support and participate in ad hoc projects requiring QA expertise.

Minimum Qualifications
- Bachelor degree or above with 1-2 years of experience, major in journalism, literature, mathematics, computer, medicine, law, and economics.
- Excellent language skills in English and Malay language.
- Knowledge about AI or related models, familiar with social media platform.

Preferred Qualifications
- Familiar with QA and data delivery process.
- Overseas working/training is a plus
- An in depth understanding of the culture and familiarity with the internet usage habit of the users.
- Strong ability to learn and understand.
- Familiar with common office software.
- Search evaluation experience is preferred.