SCADA Data Quality Automation Tester (Databricks & Azure) (m/f/d)
Responsibilities
- Develop and maintain automated test scripts in Databricks (using Python, PySpark, or SQL)
- Validate JSON messages received via AMQP for structure, completeness, and accuracy
- Implement data quality checks (e.g., schema validation, range checks, anomaly detection)
- Ensure data integrity and reliability by designing and executing automated checks on incoming data streams and recording results in Azure DevOps
- Validate data flow from SCADA through AMQP to Databricks
- Integrate tests into CI/CD pipelines for continuous validation using Azure DevOps
Profile
- Strong experience with Databricks, PySpark and JSON message handling
- Knowledge of Azure services (Data Lake, Blob Storage, Functions)
- Experience in setting up and running automated tests in Cloud Environments
- Proficiency in Python for scripting and automation
- Familiarity with CI/CD tools (Azure DevOps)
Benefits
- Start date: asap
- Remote-option
About Hays
IT is and always has been our core business that laid the foundation for Hays' success. We are the biggest privately owned IT recruitment agency in Germany and offer the best jobs for every career level – whether you are interested in vacancies in agile SMEs or international DAX groups. Hays masters the entire IT job spectrum, from support to software architecture or digitalisation – thanks to our broad portfolio, we have something for everyone. In the last decades, we were able to support numerous IT experts with choosing the right path for a successful career, positioning ourselves as their lifelong partner. Our highly specialised consultants can cater to your every wish and expectation and will prepare you for interviews and contract negotiations. Give it a try and learn what the market has to offer – our services are free of charge, non-binding and discreet! We look forward to hearing from you.
Staffing process for freelance specialists
- Analysis of qualifications
- Telephone or personal interview
- Contact with customers
- Contract with Hays
- 1
- 2
- 3
- 4
1. Analysis of qualifications
We carry out a detailed analysis of your technical qualifications on the basis of your CV, your application documents and your profile.
Contact at Hays
+ 49 621 1788-4297© Copyright Hays plc, . Le mot HAYS, les symboles H, les slogans «Hays Working for your tomorrow» et «Powering the world of work» ainsi que les logos et illustrations associés sont des marques déposées de Hays PLC. Les symboles H sont des créations originales protégées dans de nombreux pays. Tous droits réservés.