Note: The job is a remote job and is open to candidates in USA. CSI Companies is a leading staffing and recruiting firm, providing healthcare organizations with highly skilled professionals since 1994. They are seeking a Senior QA Automation Engineer with strong experience in testing modern data platforms and big data environments, focusing on validating data pipelines and cloud-based workflows. The role requires collaboration with cross-functional teams and a strong automation mindset.
Responsibilities
- Design and execute test strategies for data pipelines, big data workflows, and distributed systems within Databricks environments
- Develop and maintain automated tests using PySpark to validate large-scale data processing and transformations
- Perform end-to-end validation of data workflows across Spark-based systems and data lake architectures
- Integrate automated testing into CI/CD pipelines to support continuous delivery of data solutions
- Use QMetry to manage test cases, track defects, and maintain reporting on QA efforts
- Collaborate with product owners, scrum masters, and technical leads to align testing with business and technical requirements
- Identify defects, data inconsistencies, and performance issues across complex data systems
Skills
- 6–9+ years of experience in QA with a strong focus on automation and data testing
- Hands-on expertise in Databricks and PySpark for testing data pipelines and large-scale data workflows
- Proven experience using QMetry for test management, defect tracking, and reporting
- Strong understanding of Spark architecture, distributed computing, and data lake ecosystems
- Experience working with cloud platforms and modern data engineering environments
- Experience integrating automated tests into CI/CD pipelines
- Strong collaboration skills with the ability to guide QA efforts and work cross-functionally with product and engineering teams
- Experience testing ETL pipelines or data warehouse solutions
- Familiarity with performance testing in big data environments
- Exposure to additional automation frameworks or scripting languages
Benefits
- Weekly pay
- Medical, dental, and vision coverage
- Voluntary Life and AD&D coverage
- Paid Training
- Opportunity for advancement upon performance and availability
Company Overview
Headquartered in Jacksonville, FL, CSI Companies partners with organizations nationwide to deliver solutions-focused workforce services. It was founded in 1994, and is headquartered in Jacksonville, Florida, US, with a workforce of 51-200 employees. Its website is https://csicompanies.com/.