Job Vacancy for Data Annotation Specialist at UpSmart Solutions in Hyderabad, Sindh

At UpSmart Solutions, we’re always on the lookout for talented individuals who are passionate about technology and innovation. Explore our career opportunities and take the first step towards a rewarding career.

Experience: 3-4 Yrs.

Location: Hyderabad/Bangalore

Work Mode : In Office

Job Description:

We are seeking a Data Annotator to support the rating, testing, and operational management of large language models (LLMs), as well as handle data annotations across text, images, and video. This role includes annotating outputs, ensuring cultural and regional relevance, and managing diverse data formats such as 3D lidar, bounding boxes, and polygons. You will be instrumental in ensuring that AI/ML models are production-ready, providing detailed insights and feedback.

Key Responsibilities:

• LLM Output Testing & Rating:

  Evaluate whether LLMs (e.g., Gemini) are performing accurately in specific applications. Provide quality ratings (e.g., 7 out of 10) based on criteria like relevance, correctness, and context appropriateness.

• Text, Image & Video Annotation:

  Perform data annotation on various media formats, including text, images, and videos. Tasks include labeling, annotating, and structuring data for machine learning models.

• Image & Video Labeling:

  Label and annotate video and image data, applying bounding boxes, polygons, and key points to identify objects or regions of interest within datasets for AI training purposes.

• 3D Lidar Annotation:

  Annotate and label 3D lidar data, using tools like bounding boxes and polygons to identify objects in 3D space, enabling accurate perception for machine learning models.

• Content Review & Cultural Relevance:

  Review and rate LLM-generated outputs, annotating content for cultural fit, regional context, and overall relevance. Ensure model outputs align with the expected standards for the target audience.

• ML Code & Data Source Review:

  Assist technical teams in reviewing where data originates, helping identify potential issues with the code, data, or prompt structure, and ensuring the overall quality of inputs.

• Pilot & Testing Projects:

  Participate in testing and rating pilot projects to evaluate new or updated AI models before they go into full production. Provide detailed reports and suggest improvements.

• Operational Support:

  Support operational tasks including content rating, data labeling, and assisting in the feedback loop to continuously improve model performance based on real-world scenarios.

Skills & Qualifications:

• Analytical Skills:

  Strong analytical thinking with the ability to assess and provide detailed feedback on AI outputs and annotation tasks.

• Data Annotation Expertise:

  Proficiency in text, image, and video annotation, including experience with bounding boxes, polygons, 3D lidar annotation, and other data labeling techniques for training machine learning models.

• Cultural Sensitivity & Context Awareness:

  High attention to detail when annotating content for cultural and contextual relevance, ensuring the output aligns with regional and cultural expectations.

• Basic AI/ML Knowledge:

  Foundational understanding of machine learning models, LLMs, and data annotation processes. Familiarity with annotation tools for 2D and 3D data formats.

Preferred Experience:

• Experience in data annotation or a similar role working with LLMs, image, and video data.
• Hands-on experience with 3D lidar annotation and complex labeling tasks.
• Experience in working with google Crowdsource / Amazon Sagemaker
• Familiarity with AI/ML operations, including code and data review processes.