QA_Lead

Role Title – QA Engineer

Location – Nashville, TN (Remote)

Mode of Hire - Contract-Hire / Full-time plus benefits

About Emids:

Emids is a leading provider of digital transformation solutions to the healthcare industry, serving payers, providers, life sciences, and technology firms. Headquartered in Nashville, Emids helps bridge critical gaps in providing accessible, affordable, and high-quality healthcare by providing digital transformation services, custom application development, data engineering, business intelligence solutions, and specialized consulting services to all parts of the healthcare ecosystem. With nearly 3,500 professionals globally, Emids leverages strong domain expertise in healthcare-specific platforms, regulations, and standards to provide tailored, cutting-edge solutions and services to its clients.

Job Role:

• Define and implement testing strategies for Generative AI models, focusing on reliability, accuracy, and ethical considerations.
• Lead end-to-end testing of LLMs, chatbots, and AI-powered applications.
• Develop and execute functional, adversarial, and prompt-based testing for AI-generated outputs.
• Automate testing for response quality, hallucination detection, and factual consistency.
• Collaborate with AI/ML engineers, data scientists, and product teams to refine AI validation techniques.
• Ensure compliance with regulatory and responsible AI guidelines in healthcare AI applications.
• Monitor model drift, bias, and performance degradation over time.

Responsibilities:

• Strong experience in Generative AI testing methodologies and tools.
• Proficiency in LLM fine-tuning, prompt engineering, and AI evaluation frameworks (e.g., LangChain, OpenAI, Hugging Face).
• Hands-on experience with test automation frameworks, API testing, and CI/CD pipelines.
• Familiarity with bias detection, ethical AI principles, and explainability tools.
• Strong analytical and problem-solving skills.

We offer comprehensive benefits to keep you healthy and happy as you grow in your life and career, and your merit-based compensation will reflect the impact your work has on the company and our customers. Emids is an Equal Opportunity Employer that does not discriminate on the basis of actual or perceived race, creed, color, religion, alienage or national origin, ancestry, citizenship status, age, disability or handicap, sex, marital status, veteran status, sexual orientation, or any other characteristic protected by applicable federal, state or local laws. Our management team is dedicated to this policy with respect to recruitment, hiring, placement, promotion, transfer, training, compensation, benefits, employee activities and general treatment during employment.