DATA INGESTION ENGINEER
Descripción de la oferta de empleo
This company analyzes data from the real world to produce transparent, rapid, and scientifically validated answers on safety, effectiveness, and value.
Also, it informs health care's most critical decisions (what works best, for who, and when) to guide product development, commercialization, and payment innovation.
RoleYour primary responsibility will be developing transformation logic against disparate datasets in my client's Evidence Platform.
You will work closely with our Product and Science team in developing custom transformation logic for longitudinal data, which is in Java / Python / Scala and/or R, and executed over a Spark cluster.
In addition, you will be integral in developing and enhancing our platform and its connections to Spark and a combination of big data infrastructure.
ualifications Bachelor’s degree or equivalent in Computer Science, Computer Engineering, Information Systems, or a related field.
5+ years of experience or equivalent in the position offered or related position, including.
2 year of experience with.
designing, developing, maintaining large-scale data ETL pipelines using Java/Scala in AWS, Hadoop, Spark, and DataBricks to manage Apache Spark infrastructure.
Experience working with programming languages like Java, Python, SQL, and SCALA.
Experience or knowledge of building and optimizing ETL pipelines Experience in data quality management, data validation and/or data governance Experience building systems with large data sets Experience or working knowledge with distributed systems Experience translating requirements from product, DevOps teams to technology solutions using SDLC.
What they offer Work-life Balance 25 vacation days Flexible start and end of working day Flexible in-office work commitment Sabbatical opportunity after five years of employment Benefits Daily in-office lunch stipend and a fully stocked kitchen Comprehensive private health coverage w/ out-of-network reimbursement o
Detalles de la oferta
- Sin especificar
- 02/10/2024
- 31/12/2024
Are you a big data engineer looking for a new challenge? so... solid knowledge of data structures and experience with integration of data from multiple sources... proven practical experience in managing data ingestion projects in hadoop environments using agile methodologies... ensures that non-functional/support......
Your profile: at least 3y of experience working as a qa automation engineer... are you a qa automation engineer looking for new challenge? we aspire to reach everyone and connect them to top projects... collaborate closely with developers, designers, and product owners... run automated tests... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......
Our division focuses on gathering, enriching and processing data for machine learning in different ai domains... we offer high-quality data for human-machine interaction to some of the most prestigious technology companies in the world... position: data contributor project location: barcelona, spain......
Img arena is looking for sports fans in spain to collect live data from basketball games... this position is not remote, so your presence at the venue would be required to ensure accurate and timely data collection... benefits 45€ for each event covered freelancer agreement for 1 year with the possibility......
Who are we looking for ? the space and resilient communications and systems unit is looking for a satellite communications engineer... * cvs and any other information gathered during this process will be handled confidentially who are we? the center tecnològic de telecomunicaciones de catalunya (cttc)......
Parte de tus funciones serán: desarrollo e implementación de políticas de datos seguridad y cumplimiento datos maestros y metadatos gestión de calidad de datos evaluación y mitigación de riesgos formación y capacitación reportes innovación y mejora continua requisitos del puestoqué valoramosbuscamos......
Are you a devops / site reliability engineer seeking new interesting opportunity? so... a lot of different internal trainings (tech and non-tech) + meetups+ special training budget that you can use for whatever you want to (certifications, books, events, etc) + languages courses... com/es-es/meetup-de-innoit-consulting-en-barcelona/?_locale=es-es......
*cvs and any other information gathered during this process will be handled confidentiallywho are we?• the center tecnològic de telecomunicaciones de catalunya (cttc) is a non-profit public sector research institution dedicated to fundamental and applied research activities, focused mainly on technologies......
Confidencial cuenta con una posición como qa engineer para garantizar la calidad del software mediante pruebas exhaustivas para identificar y corregir errores antes de su lanzamiento al mercado... automatizar pruebas utilizando herramientas como selenium o appium... 000,00 € eur por año bruto jornada......
Com/project/tahoe-nl?/fill?id313=df035 join our data collection project tahoe in barcelona, spain! project overview: purpose: collect voice recordings to improve speech recognition technologies... referred participants must complete the project... if you have any questions, contact us at: *****@*****......
