• Publicar trabajo
  • Subir CV
  • Acceder
Ver oferta completa

SENIOR DATA ENGINEER

Descripción de la oferta de empleo

Senior Cloud Data Software EngineerOur Data Foundation - Big Data Management team focuses on designing and maintaining a scalable platform for managing vast volumes of data. By leveraging Azure PaaS components, we facilitate Big Data workload deployment and management, empowering our clients to make data-driven decisions. Our team is responsible for building and maintaining an Azure PaaS-based Enterprise Data Lake (EDL) platform, ensuring its scalability, security, and reliability. We work closely with internal partners to understand their needs and develop tailored solutions, staying ahead of the latest trends in Big Data.We are seeking a proactive, detail-oriented professional to lead data distribution efforts through Databricks Unity Catalog and manage and optimize CI/CD pipelines in a collaborative, high-performance environment.Key Responsibilities:Design, implement, and maintain data distribution strategies using Unity Catalog with Azure Databricks and Azure Data Factory.Oversee data distribution across multiple platforms, optimizing data distribution pipelines.Implement quality control measures to ensure data accuracy and consistency.Collaborate with the Data Science team to meet data requirements.Troubleshoot data-related issues, optimizing distribution for performance and scalability.Document technical processes related to data distribution and evaluate improvements in Unity Catalog and other Azure tools.Main Requirements:Degree in Computer Science, IT, Engineering, or related fields.Minimum of 3-4 years of experience in DataOps using Azure, Python, Azure Data Factory, and Databricks.Experience with agile methodologies and a DevOps mindset.Strong skills in automation and scripting with tools like Azure DevOps and Azure Data Factory.Expertise in Big Data concepts and Databricks.Proficiency in developing and maintaining data distribution pipelines.Knowledge of Unity Catalog for data distribution via Databricks.Advanced proficiency in English.Additional Desired Skills:Experience in event-driven architectures and streaming tools (Kafka, RabbitMQ, etc.).Familiarity with modern DevOps and CI/CD practices (Terraform, automation, etc.).Experience with data catalog integration (e.g., Collibra) and Big Data platforms.Vendor certifications (e.g., Microsoft, Linux).Strong communication skills and ability to work well within a team.
Ver oferta completa

Detalles de la oferta

Empresa
  • Tenth Revolution Group
Localidad
  • En toda España
Dirección
  • Sin especificar - Sin especificar
Fecha de publicación
  • 14/11/2024
Fecha de expiración
  • 12/02/2025
Cómo detectar ofertas falsas
Data Engineer
Innoit

Are you a big data engineer looking for a new challenge? so... solid knowledge of data structures and experience with integration of data from multiple sources... ensures that non-functional/support aspects of data classification and data sharing agreements (dsas) and sign-offs are fulfilled... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......

Qa automation engineer
Innoit

Your profile: at least 3y of experience working as a qa automation engineer... are you a qa automation engineer looking for new challenge? we aspire to reach everyone and connect them to top projects... you will participate in defining and driving automated testing strategies... selenium, cypress)......

Data Collection Project Tahoe - Dutch or French Speaker
TransPerfect DataForce

Our division focuses on gathering, enriching and processing data for machine learning in different ai domains... we offer high-quality data for human-machine interaction to some of the most prestigious technology companies in the world... position: data contributor project location: barcelona, spain......

Basketball Data Collector
IMG AREBA

Img arena is looking for sports fans in spain to collect live data from basketball games... this position is not remote, so your presence at the venue would be required to ensure accurate and timely data collection... benefits 45€ for each event covered freelancer agreement for 1 year with the possibility......

Asistente de atención médica Senior - Coordinador de turnos
Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - car home / asistencia domiciliaria - turnos de día y de noche - centro de atención continua y domiciliaria - cornwall reino unido reach......

Asistente de atención médica Senior - Coordinador de turnos
Reach HR Consulting

Estamos buscando un asistente de atención médica senior para coordinar la prestación de atención médica... asistente de atención médica senior - coordinador de turnos - asistencia domiciliaria / asistencia domiciliaria - turnos de día y noche - centro de atención continua y domiciliaria - cornwall reino......

Data Governance Analyst
LLYC

Parte de tus funciones serán: desarrollo e implementación de políticas de datos seguridad y cumplimiento datos maestros y metadatos gestión de calidad de datos evaluación y mitigación de riesgos formación y capacitación reportes innovación y mejora continua requisitos del puestoqué valoramosbuscamos......

Devops engineer
Innoit

Are you a devops / site reliability engineer seeking new interesting opportunity? so... work in our multidisciplinary team and stakeholders, helping to understand business requirements, formulate use cases and then translate that into a pragmatic and effective technical solution... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......

Diseñador Gráfico Senior UI/UX
S&F

Diseñador/a gráfico senior ui/ux, con experiencia demostrable para integrarse de forma inmediata en nuestro gran equipo de desarrolladores, realizando tareas de diseño ui/ux/ixd, animaciones y branding para proyectos digitales tecnológicos innovadores... arquitectura de la información (ia)......

Técnicos senior de radiología - Unidad de salud móvil
Reach HR Consulting

Técnicos senior de radiología - reino unido - unidad de salud móvil de imágenes reach hr es una empresa especializada en la contratación de profesionales sanitarios... rhr busca contratar técnicos de radiología para trabajar como proveedores de diagnóstico y atención médica para el nhs, el servicio nacional......