Software Quality Analyst Job at Codeworks L.L.C, Oregon State

TDBCbnBucW9xRlZMV0ZEaHFCZmxYVm1zRWc9PQ==
  • Codeworks L.L.C
  • Oregon State

Job Description

Job Description

Job Description

No C2C

Our client is the largest physician-led and physician-owned practice in their area of specialty in the United States.

Position: Software Quality Analyst – 6 month contract to hire

Location: Wisconsin – fully REMOTE

We are seeking an excellent Quality Analyst to validate our cutting-edge AI-powered reporting solution within our medical specialty product line. This role involves working closely with a development team leveraging Amazon AWS and Large Language Models (LLM) to automate the interpretation of radiology reports, and explicitly summarizing the radiologist’s findings to streamline the review process; thus, providing the most accurate and relevant information at-a-glance.

As the Quality Analyst, you will be responsible for ensuring the accuracy and reliability of AI models through rigorous testing, automation, and data validation. The ideal candidate will have a strong background preferably in automation, scripting, and data integrity, with a focus on AWS-based systems and machine learning models. Any experience with evaluating LLMs against BERTscores, ROUGE (Recall-Oriented Understudy for Gisting Evaluation), BLEU (Bilingual Evaluation Understudy), METEOR (Metric for Evaluation of Translation with Explicit ORdering) would also be very helpful.

Required Skills

  • Experience with Large Language Models (LLM) and machine learning-based testing.
  • Strong expertise in AWS cloud services. (Lambda, S3, Bedrock, etc.)
  • Proficiency in scripting languages such as Python or C#.
  • Hands-on experience with Automation tools (e.g., Selenium, or similar).
  • Ability to perform Data Integrity checking and strong SQL skills for writing queries.

Nice to Have

  • Familiarity with foundational and custom models like Bedrock, Sagemaker, etc.
  • Knowledge of microservices architecture.
  • Familiarity with healthcare or radiology domains.

Codeworks L.L.C. is a full-service IT Consulting and Staffing Services company. Headquartered in Milwaukee, WI—Codeworks has more than 25 years of experience connecting great people to great companies. Codeworks services companies nationwide ranging from start-ups to Fortune 100 corporations. Our Recruiting team consists of highly skilled Talent Specialists who excel at evaluating, advising, and connecting IT professionals with new career opportunities that facilitate career growth.

At Codeworks, we're committed to diversity, equity, and inclusion in our workforce and beyond. We believe in equal opportunities and value the unique perspectives that every individual brings to our team. Join us in creating an inclusive, innovative, and collaborative workplace where your talents can thrive.

#LI-DNI

Job Tags

Contract work, Remote job,

Similar Jobs

Lavender

Lead Psychiatric Nurse Practitioner Job at Lavender

 ...Founded in 2020, Lavender is the largest nurse-owned and operated online psychiatry and...  ...of 100+ talented and like-minded folks works remotely from across the United States,...  ...seeking an experienced Lead Psychiatric Nurse Practitioner to provide clinical leadership for our... 

Legal Defense Fund

Community Organizer Job at Legal Defense Fund

 ...the country's first and foremost civil and human rights law organization. Founded in 1940 under the leadership of Thurgood Marshall, who...  ...a creative problem solver, strong advocate, and skilled Community Organizer to join its organizing team to advance its reform work... 

Children and Families First Delaware Inc

Building and Maintenance Tech I (Custodian) Job at Children and Families First Delaware Inc

 ...Description: Follows a regular cleaning schedule for classrooms, kitchen, office area, bathrooms, storage areas, and entrances of all exposed spaces, and floors. Completes minor repairs at centers and offices upon request. Ensures major repairs and maintenance... 

The Town Dock

Regulatory Coordinator Job at The Town Dock

 ...manufacturing environment? If you said yes, then our Regulatory Coordinator role at The Town Dock might be right for you! The...  ...compliance with regulatory requirements relating to food safety and quality compliance. This position manages document control... 

Georgetown Learning Centers

Online Writing Tutor Job at Georgetown Learning Centers

Online Writing Tutors Needed! (Remote/Online)ThinkingStorm is a leading national online tutoring company seeking writing tutors toreview students online submissions.Our ideal tutor has a BA/BS degree or higher in a writing-intensive field, experiencereviewing...