DATA ENGINEER

At Capitole, we keep growing, and we want you to be part of the family! 😎As part of the Data & AI team, you will contribute as a Senior Data Engineer to Data ingestion cleaning and processing projects based on cloud native tools, applied to various business areas.You will:Design and build ETL/ELT processes for ingesting and processing large datasets using Azure Data Factory, Databricks, Synapse and other Azure services like eventhub.Manage, monitor, and optimize data storage solutions such as Azure SQL Database, Azure Synapse Analytics, and Azure Data Lake Storage.Create and maintain scalable data models that support analytics and machine learning needs.Integrate diverse data sources and formats, ensuring data quality and consistency for reliable business insights.Implement data security and compliance best practices, including data encryption, identity management, and data governance in Azure.Optimize data pipelines and storage solutions for high performance and cost efficiency.Work closely with cross-functional teams, including data scientists, architects, and developers, to understand and meet data requirements.Maintain comprehensive documentation of data architectures, data flows, and pipeline configurations for transparency and knowledge sharing.Use tools that reinforce DevOps practices: Git and Azure DevOps for versioning, source control and deployment.Participate in creating and maintaining Data and AI model pipelines to ensure continuous and reliable delivery of models to production.Your profile:Master’s degree in Computer Science, Information Technology, Engineering, or a related field.You will have at least 3 years' experience in deploying data processing pipelines with a main focus on Azure cloud solutions. You have a bilingual or proficiency level of English, it would be your main language in this project. 😊Technical skills :Proficiency in Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics.Strong knowledge of SQL, Python, and Spark.Good understanding of data streaming technologies like (EventHub, Kafka etc…).Familiarity with Data Lake Storage, DataBricks, and Blob Storage for data storage and transformation.Hands-on experience with ETL/ELT development and data pipeline orchestration.Data Modeling and Data Warehousing.Experience of Azure DevOps /github and CI/CD pipelines.Cloud technologies like (AWS, GCP) is a plus.Terraform, docker, Ansible and command bash.Other skills:Understand business needs and expectations ; Communicate technical concepts clearly to a non-technical audience ; ability to analyse and summarise ; agile and collaborative mindset ; Curiosity and monitoring of virtualisation and containerisation issues.This position is Hybrid (2 days per week attending at the office).Why Capitole? 🙌We are great, but with you, we will be even greater 😊. That is why you will have:📚 Individual training budget of €1200 (languages, books, certifications)🔄 Flexible working hours🥗 Flexible remuneration package🏀 Great discounts at sports centers (AndJoy)👨‍⚕️ Free private health insurance📈 Monthly follow-ups with your team to have continuous feedback🍻 Team Buildings every two months. You can't miss the Pool Party💧 and our Christmas dinner🎄🛍️ Discounts in international brands for employees (Club Capitole)You will have the opportunity to meet the whole family through our Technology communities, to share your knowledge and ideas. Knowledge exchange is key to us!Do not know us yet? Discover more here https://capitole-consulting.com/And have a look to how others think we are 👀 https://www.glassdoor.es/Opiniones/Capitole-Consulting-Opiniones-E2060890.htmlWe are excited to meet you! 😎Information Security Policy:Access to confidential information related to Capitole and the specific project you are working on.Compliance with company and client security policies and internal procedures.A non-disclosure agreement (NDA) must be signed.