Application QA Tester – CMS Business Requirements

Full-Time | Remote | US Eastern Standard Time


We are seeking a detail-oriented and highly analytical Application QA Tester to support the verification and validation of eligibility requirements within a Healthcare Application. The ideal candidate should have experience in Healthcare Application QA, particularly in testing for compliance with CMS Business requirements as it relates to the US Affordable Care Act (ACA). This role involves reviewing the screens, text and eligibility testing, and ensuring the accuracy of API data exchanges.

The candidate must be adept at control documentation, identifying control discrepancies, and providing structured reports to support the CMS certification audit process and advisory projects.

Responsibilities:

  • Perform eligibility tests by running the application and determining whether the requirements in the toolkit are met as described.
  • Capture detailed screenshots to show the eligibility requirement flow and rename the screenshots using the CMS naming convention
  • Execute test scripts to validate automatic applicant eligibility, including capturing the last JSON call and response
  • Perform API testing: App_UI and understand the conditions that would trigger specific screens as indicated I the UI and prepare an application that would produce them
  • Must be able to quickly understand an application flow, prepare cases (application sample) that would trigger the most screens, create an Eligibility application for each test sample, ensure every screen matches the key words in the UI (single parent, married couples, foster kids, etc.) and verify that the application flow works as intended
  • Must demonstrate an understanding of the logic and use the same application to produce alternate results to thoroughly test the application
  • Extreme attention to detail and meticulous documentation is necessary for this role
  • Create and execute eligibility test cases to generate application variations, ensuring the UI displays correct text based on applicant scenarios.
  • Validate screen hints, help text, navigation logic, and error handling.
  • Document the entire data exchange approval process, identifying discrepancies in UI, screen flow, and data variables.
  • Verify that application logs, real-time callbacks, and JSON responses align with CMS requirements.
  • Ensure all email communications related to applications (English & Spanish) meet CMS compliance standards.
  • Develop specific cases to trigger rare eligibility screens (e.g., veteran medical plans, American Indian status, complex insurance selections).
  • Support the Communication Toolkit requirements by validating dashboard application management screens and documentation.

Qualifications:

  • Proven experience as a QA Tester in Healthcare Applications testing for compliance with CMS Business requirements
  • Strong understanding of API testing, JSON data analysis, and backend data validation.
  • Experience in manual UI/UX testing, including text verification, screen navigation, and user journey testing.
  • Ability to create detailed test documentation, including walkthroughs, control narratives, and test case reports.
  • Strong analytical and problem-solving skills, with an aptitude for identifying inconsistencies and logical errors in workflows.
  • Detail-oriented mindset with critical thinking abilities and a proactive approach to questioning application behavior.
  • Experience with CMS naming conventions and documentation standards for screenshots and test case tracking.
  • Familiarity with test automation tools for capturing screen sequences and API calls (e.g., Postman, Selenium, JMeter).
  • Excellent verbal and written communication skills for reporting issues and collaborating with development teams.
  • Ability to work independently and collaboratively in a fast-paced environment.

Insights

  • A Startup’s Guide to Choosing the Right Business Laptop for Remote Work
  • Technical Hiring Manager’s Guide to Interviews
  • Understanding the Recruitment Pipeline for Startups