DATA ENGINEER

Job SummaryWe are seeking an experienced Data Engineer to drive the development of our industrial digital platform with an acute focus on rigorous data validation. The ideal candidate will design, build, and maintain scalable data pipelines and infrastructure, ensuring that robust data quality checks and validations are integral to every process. You will collaborate with process engineers, data scientists, analysts, and other stakeholders to support critical decision-making through precise, validated, and secure data.Key Responsibilities: • Data Validation & Quality Assurance: Design, implement, and enforce comprehensive data validation protocols throughout all data management systems to ensure data accuracy, consistency, and integrity. • Scalable Infrastructure: Construct, test, and maintain highly scalable data pipelines that integrate advanced data validation processes at every stage. • ETL Process Enhancement: Develop and continuously improve ETL (Extract, Transform, Load) processes with built-in, automated data validation checks to promptly detect and resolve data discrepancies. • Cross-Functional Collaboration: Work closely with process engineers, data scientists, and analysts to gather detailed data requirements and implement validation-driven solutions that meet stringent industrial standards. • Database Optimization: Optimize database performance and storage solutions while integrating validation mechanisms to ensure ongoing data reliability. • System Monitoring & Troubleshooting: Monitor system performance rigorously, promptly identifying, troubleshooting, and resolving issues to maintain uninterrupted, validated data flow. • Continuous Improvement: Stay updated with emerging industrial data management technologies and validation methodologies, integrating innovative solutions to enhance data integrity and process automation.Qualifications: • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. • 8+ years of experience in data engineering or a related role, with demonstrable expertise in industrial data environments. • Strong proficiency in SQL and extensive experience with ETL tools, emphasizing data validation and quality assurance measures. • Proven experience with cloud-based data platforms Azure and Databricks• Deep understanding of data modeling, data warehousing, and big data technologies (e.g., Hadoop, Spark). • Proficiency in programming languages such as Python, Java, or Scala. • Exceptional problem-solving abilities with keen attention to detail and data accuracy. • Excellent communication and collaboration skills for working with multidisciplinary teams.Preferred Skills (Azure / Databricks Environment): • Hands-on experience with Microsoft Azure • Proficiency in leveraging Databricks for building and maintaining scalable data pipelines with integrated data validation processes. • Expertise in configuring and optimizing data lakes and data warehouses within the Azure ecosystem. • In-depth knowledge of data governance and security practices tailored for cloud environments. • Familiarity with real-time data processing and streaming on Azure • Experience with containerization and orchestration toolsLanguages: • English – Fluent (mandatory) • Spanish – Highly desired • Italian – Highly desired