DATA INGESTION ENGINEER
Descripción de la oferta de empleo
This company analyzes data from the real world to produce transparent, rapid, and scientifically validated answers on safety, effectiveness, and value.
Also, informs health care's most critical decisions (what works best, for who, and when) to guide product development, commercialization, and payment innovation.
oleYour primary responsibility will be developing transformation logic against disparate datasets in my clients Evidence Platform.
You will work closely with our Product and Science team in developing custom transformation logic for longitudinal data, which is in Java / Python / Scala and / or R, and executed over a Spark cluster.
In addition, you will be integral in developing and enhancing our platform and its connections to Spark and a combination of big data infrastructure.
ualificationsBachelor’s degree or equivalent in Computer Science, Computer Engineering,Information Systems, or a related field.
+ years of experience or equivalent in the position offered or related position, including.
year of experience with.
designing, developing, maintaining large-scale data ETL pipelines using Java/Scala in AWS, Hadoop, Spark, and DataBricks to manage Apache Spark infrastructure.
xperience working with programming languages like Java, Python, SQL, and SCALA.
xperience or knowledge of building and optimizing ETL pipelinesExperience in data quality management, data validation and/or data governanceExperience building systems with large data setsExperience or working knowledge with distributed systemsExperience translating requirements from product, DevOps teams to technology solutions using SDLC.
hat they offerWork-life Balance- 25 vacation days- Flexible start and end of working day- Flexible in-office work commitment- Sabbatical opportunity after five years of employmentBenefits- Daily in-office lunch stipend and a fully stocked kitchen- Comprehensive private health coverage w/ out-of-network reimbursement options- Relocation to Barcelona supported with external provider services
Detalles de la oferta
- Sin especificar
- 30/08/2024
- 28/11/2024
Are you a big data engineer looking for a new challenge? so... solid knowledge of data structures and experience with integration of data from multiple sources... proven practical experience in managing data ingestion projects in hadoop environments using agile methodologies... ensures that non-functional/support......
Your profile: at least 3y of experience working as a qa automation engineer... are you a qa automation engineer looking for new challenge? we aspire to reach everyone and connect them to top projects... collaborate closely with developers, designers, and product owners... selenium, cypress)... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......
Our division focuses on gathering, enriching, and processing data for machine learning in different ai domains... we offer high-quality data for human-machine interaction to some of the most prestigious technology companies in the world... position: data contributor project location: spain(remote) engagement......
Our division focuses on gathering, enriching and processing data for machine learning in different ai domains... we offer high-quality data for human-machine interaction to some of the most prestigious technology companies in the world... position: data contributor project location: barcelona, spain......
Who are we looking for ? the space and resilient communications and systems unit is looking for a satellite communications engineer... * cvs and any other information gathered during this process will be handled confidentially who are we? the center tecnològic de telecomunicaciones de catalunya (cttc)......
Who are we looking for ? the space and resilient communications and systems unit is looking for a satellite communications engineer... * cvs and any other information gathered during this process will be handled confidentially who are we? the center tecnològic de telecomunicaciones de catalunya (cttc)......
Parte de tus funciones serán: desarrollo e implementación de políticas de datos seguridad y cumplimiento datos maestros y metadatos gestión de calidad de datos evaluación y mitigación de riesgos formación y capacitación reportes innovación y mejora continua requisitos del puestoqué valoramosbuscamos......
Are you a devops / site reliability engineer seeking new interesting opportunity? so... keep reading it can be just what you're looking for! responsibilities: develop and maintain systems to support the company business... experience with databases (mysql, postgresql and elasticsearch)... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......
*cvs and any other information gathered during this process will be handled confidentiallywho are we?• the center tecnològic de telecomunicaciones de catalunya (cttc) is a non-profit public sector research institution dedicated to fundamental and applied research activities, focused mainly on technologies......
Confidencial cuenta con una posición como qa engineer para garantizar la calidad del software mediante pruebas exhaustivas para identificar y corregir errores antes de su lanzamiento al mercado... colaborar con el equipo de desarrollo para mejorar los procesos de calidad del software......
