Assamese AI Language Evaluator (LLM Response Evaluation)

<p><strong>Assamese AI Language Evaluator </strong></p><p><br></p><p><strong> Location:</strong> Remote</p><p> <strong>Employment Type:</strong> Contract / Freelance</p><p><br></p><p><strong>About the role</strong></p><p>We are looking for native <strong>Assamese</strong> speakers with excellent analytical skills to evaluate AI-generated responses. In this role, you will review conversations produced by large language models (LLMs), identify factual issues and reasoning gaps, and provide detailed feedback in English to help improve AI quality.</p><p><strong>Important:</strong> Candidates must complete a <strong>Bilingual Competency Interview in Assamese</strong> to be considered.</p><p><br></p><p><strong>Key Responsibilty</strong></p><ul><li>Evaluate AI-generated responses written in Assamese.</li><li>Assess responses for:</li><li>Factual accuracy</li><li>Reasoning quality</li><li>Clarity and coherence</li><li>Tone and style</li><li>Completeness</li><li>Fact-check responses using reliable public sources when necessary.</li><li>Identify strengths, weaknesses, inconsistencies, and hallucinations.</li><li>Write detailed evaluation reports and feedback in English.</li><li>Compare multiple AI responses and determine which performs better based on established quality guidelines.</li><li>Ensure responses align with conversational best practices and project requirements.</li></ul><p><br></p><p><strong>Required Qualification</strong></p><ul><li>Native-level fluency in <strong>Assamese</strong>.</li><li>Strong written and spoken English.</li><li>Bachelor's degree in any discipline.</li><li>Experience using AI tools such as ChatGPT, Claude, Gemini, or other large language models.</li><li>Excellent analytical and critical thinking skills.</li><li>Strong attention to detail.</li><li>Ability to clearly explain reasoning and provide structured written feedback in English.</li><li>Comfortable conducting online research and fact-checking.</li></ul><p><br></p><p><strong>Nice to have</strong></p><ul><li>Experience in AI data annotation, RLHF, or model evaluation.</li><li>Background in research, linguistics, engineering, analytics, policy, journalism, or technical writing.</li><li>Experience reviewing, editing, or evaluating written content.</li><li>Familiarity with prompt engineering or AI-assisted workflows.</li></ul><p><br></p><p><strong>What we are looking for</strong></p><p>Successful candidates will be able to:</p><ul><li>Identify factual inaccuracies and hallucinations.</li><li>Detect logical and reasoning errors.</li><li>Evaluate tone, helpfulness, and conversational quality.</li><li>Produce consistent, high-quality evaluation reports.</li><li>Make fine-grained qualitative comparisons between multiple AI responses.</li></ul><p><br></p><p><strong>Mandatory Screening</strong></p><p>All shortlisted candidates must:</p><ul><li>Pass a <strong>Bilingual Competency Interview in Assamese</strong>.</li><li>Demonstrate native-level Assamese proficiency.</li><li>Demonstrate strong written English skills for evaluation reporting.</li></ul><p><br></p><p><strong>Work Details</strong></p><ul><li>Remote work</li><li>Contract/Freelance engagement</li><li>Flexible working hours</li><li>Project-based opportunity </li></ul><p><br></p>