About Tech Mahindra

Tech Mahindra is a leading global provider of digital transformation, consulting, and business re-engineering services. Part of the Mahindra Group, the company operates across 90+ countries, delivering cutting-edge technology solutions to Fortune 500 enterprises. With a strong focus on artificial intelligence, cloud computing, and next-generation digital platforms, Tech Mahindra continues to push the boundaries of innovation. The organization fosters a culture of continuous learning, collaboration, and professional excellence, making it one of the most sought-after employers in the Indian IT and AI ecosystem.

Role Overview

Tech Mahindra is currently seeking a Research Analyst – AI Evaluation & Annotation to join its growing AI and data operations team based in Noida, Sector-62. This is a 3-month contractual position designed for experienced professionals who possess a keen analytical mindset and a genuine interest in artificial intelligence, machine learning evaluation frameworks, and data quality assurance. The successful candidate will play a critical role in assessing the performance, accuracy, and reliability of AI-powered web agents across diverse real-world user scenarios. This is not a routine data entry role — it demands structured thinking, attention to detail, and the ability to critically evaluate how AI systems respond to complex prompts and user interactions.

Key Responsibilities

Evaluate AI web agents by executing and monitoring real-world user journeys, ensuring that agent responses meet predefined quality benchmarks and performance standards across multiple domains and use cases.
Design, execute, and document systematic test prompts to probe AI agent behavior, identifying edge cases, inconsistencies, and areas requiring improvement in agent logic and output quality.
Annotate AI agent interactions by tagging decision-making patterns, response accuracy, contextual relevance, and logical coherence using internal annotation tools and standardized taxonomies.
Review and validate AI-generated content for factual accuracy, grammatical correctness, tone appropriateness, and alignment with user intent across diverse query categories.
Collaborate with data science and machine learning engineering teams to communicate evaluation findings, providing structured feedback reports that directly inform model retraining and fine-tuning efforts.
Develop and maintain detailed documentation of evaluation methodologies, annotation guidelines, and quality assurance protocols to ensure consistency across the annotation team.
Track and report key performance metrics related to AI agent accuracy, error rates, and user satisfaction scores, presenting weekly summaries to project stakeholders.
Participate in calibration sessions with cross-functional teams to align evaluation criteria, resolve ambiguous cases, and maintain inter-annotator agreement above established thresholds.
Identify recurring failure patterns in AI agent behavior and contribute to the creation of new test scenarios that stress-test agent capabilities under varied conditions.
Ensure compliance with data privacy and confidentiality protocols when handling sensitive user interaction data and proprietary AI model outputs throughout the evaluation lifecycle.

Work Environment & Culture

This role is based at the Tech Mahindra office in Noida, Sector-62, and follows a 5-day in-office working schedule. The position involves rotational shifts, so candidates must be comfortable working across different shift timings, including potential evening or weekend rotations depending on project requirements. The work environment is fast-paced, intellectually stimulating, and deeply collaborative. You will be part of a team that values curiosity, precision, and data-driven decision-making. Tech Mahindra provides a structured onboarding experience for contractual employees, ensuring that every team member is equipped with the tools, context, and domain knowledge needed to perform effectively from day one.

Required Qualifications & Experience

Minimum 1–3 years of professional experience in data annotation, AI evaluation, content quality analysis, linguistic analysis, or a closely related research-oriented role.
Bachelor's degree in Computer Science, Linguistics, Data Science, Cognitive Science, Information Technology, or a related field from a recognized institution.
Demonstrated experience working with AI/ML evaluation frameworks, prompt engineering, or human-in-the-loop quality assurance processes.
Strong analytical and critical thinking skills with the ability to assess complex AI outputs against multi-dimensional quality criteria.
Excellent written and verbal communication skills in English, with the ability to articulate evaluation findings clearly in structured reports.
Comfortable working with annotation platforms, spreadsheets, and project management tools such as Jira, Confluence, or similar enterprise collaboration software.
Ability to work independently while maintaining alignment with team objectives and project deadlines in a high-volume evaluation environment.

Technical Skills & Tools

Familiarity with AI annotation and evaluation platforms (e.g., Labelbox, Scale AI, Appen, or proprietary internal tools).
Proficiency in Microsoft Excel, Google Sheets, and data visualization tools for tracking evaluation metrics and generating reports.
Understanding of large language model (LLM) behavior, prompt-response dynamics, and common failure modes in generative AI systems.
Basic knowledge of Python or SQL for data querying and analysis is a strong advantage.
Experience with version control documentation and collaborative editing tools such as Confluence or Notion.

Compensation & Benefits

Salary Range: ₹4,00,000 – ₹5,00,000 per annum, commensurate with experience and qualifications.
Contract Duration: 3 months with potential for extension or conversion to a permanent role based on performance and project requirements.
Structured shift allowances applicable for rotational shift workers as per company policy.
Access to Tech Mahindra's internal learning platforms and AI/ML training resources during the contract period.
Opportunity to work on cutting-edge AI evaluation projects with real-world impact across global client engagements.

Career Growth

Tech Mahindra offers a unique opportunity for professionals looking to build a career in the rapidly expanding field of AI evaluation and data operations. Contractual team members who demonstrate strong performance and domain expertise are often considered for full-time positions within the organization's AI, analytics, and data engineering verticals. This role serves as an excellent entry point into the broader AI industry, providing hands-on exposure to model evaluation, prompt engineering, and quality assurance at scale — skills that are increasingly in demand across technology companies worldwide.

How to Apply

Interested candidates who meet the above criteria are encouraged to send their updated resume directly to Kunika Mehta at Kunika.mehta1@techmahindra.com. Please include "Research Analyst – AI Evaluation & Annotation – Noida" in the subject line of your email. Applications will be reviewed on a rolling basis, and shortlisted candidates will be contacted for an initial screening call followed by a practical evaluation exercise and a final interview with the hiring manager. Early applications are strongly encouraged as the position will be filled on a first-come, first-served basis.