Job Summary: As a Test Data Engineer (Data QA) with 8-14 years of experience, you will be responsible for ensuring the quality and reliability of our data products and solutions. You will design, implement, and manage data testing processes, tools, and frameworks to ensure data integrity, accuracy, and performance. Your expertise in data quality assurance and testing methodologies will be crucial in supporting our data-driven initiatives.
Key Responsibilities:
-
Data Quality Assurance:
- Develop and implement comprehensive data testing strategies, plans, and scripts to ensure data integrity and accuracy.
- Perform data validation, data transformation, and data migration testing.
- Identify, document, and track data quality issues and defects, and work with development teams to resolve them.
-
Test Data Management:
- Design and maintain test data management processes, including the creation, maintenance, and provisioning of test data sets.
- Ensure test data sets are representative of production data and meet the testing requirements.
- Automate test data generation and management processes where possible.
-
Automation and Tools:
- Develop and maintain automated data testing frameworks and scripts.
- Utilize data quality and testing tools (e.g., Talend, Informatica, QuerySurge, DQ tools) to perform testing and validation.
- Integrate data testing processes with CI/CD pipelines to ensure continuous testing and delivery.
-
Collaboration and Communication:
- Collaborate with data engineers, data scientists, and business analysts to understand data requirements and testing needs.
- Provide detailed reports and insights on data quality and testing outcomes to stakeholders.
- Mentor and guide junior team members in data testing best practices and methodologies.
-
Performance and Scalability Testing:
- Conduct performance and scalability testing of data systems and solutions.
- Identify and address performance bottlenecks and issues to ensure optimal data system performance.
-
Compliance and Best Practices:
- Ensure data testing processes comply with industry standards and best practices.
- Stay updated with the latest trends and advancements in data testing and quality assurance.
Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, or a related field. A Master’s degree is a plus.
- 8-14 years of experience in data quality assurance, data testing, or a related field.
- Strong knowledge of data management, data governance, and data quality principles.
- Proficiency in SQL and scripting languages such as Python or Shell.
- Experience with data testing and quality tools (e.g., Talend, Informatica, QuerySurge).
- Experience with test automation frameworks and tools.
- Familiarity with CI/CD pipelines and version control systems (e.g., Git).
- Excellent analytical and problem-solving skills.
- Strong communication and interpersonal skills.
- Ability to work effectively in a fast-paced, collaborative environment.