Loading profile…
Akshat Kumar
Open to opportunitiesAI Quality Analyst
I evaluate LLM quality and build AI-powered business automation tools.
IndiaAI Quality Analyst at Turing
About
At Innodata India, I evaluated LLM outputs for quality, factual accuracy, reasoning, and instruction-following, contributing preference judgments and annotation reviews to RLHF workflows.
I've also performed QA across text, image, and audio AI tasks, identified generative AI failure patterns, and delivered actionable feedback to improve model performance. Through Excelerate × Saint Louis University, I developed project plans, budgets, contingency strategies, stakeholder communications, and QA processes for a global AI-focused virtual event.
I build practical AI tools, including a Streamlit app that converts business requirements into structured business-analysis documentation and an n8n job-aggregation workflow powered by Gemini AI and Google Sheets.
Experience
AI Quality Analyst
Evaluated Gemini’s personalization through multi-turn prompts using real user context. Compared model responses on helpfulness, naturalness, and personalization. Verified claims against evidence, identified hallucinations and flawed inferences, documented turn-specific rationales, checked debug data sources, and maintained clean evaluation chats to prevent cross-session contamination.
AI Training
Analyst – AI/LLM Practice
Performed human evaluation of LLM outputs, assessing quality, factual accuracy, reasoning, and instruction-following. Contributed to RLHF workflows and conducted QA on AI annotations across multimodal tasks.
LLM EvaluationQAAnnotationsGenerative AI
Education
KIIT University
Pursuing a Bachelor of Technology in Information Technology with a CGPA of 8.06.
S.N.S College
Completed 12th grade in Science with 72%.
St. Paul's High School
Completed 10th grade under CBSE with 73.6%.