SENIOR BIG DATA ENGINEER

Specific-Group is an International software development company, delivering custom software solutions for enterprise clients in Europe and USA. Our development centers are located in Austria, Belarus, Germany, Lithuania, Poland and Spain. Our primary focus & areas of expertise is a financial domain. We deliver our solutions according to the latest technical standards for different industries and sectors, using new technologies and modern approaches.Currently, we are looking for a Senior Big Data Engineer who will play a key role in the entire software development lifecycle. This includes everything from defining concepts and technical design to implementation and ongoing maintenance, with a strong focus on continuous product improvement. You will be part of a self-organized, autonomous team that values constant learning and professional development. Sharing expertise, mentoring teammates, and contributing to the collective growth of the team are essential aspects of the role.Project description: The project is positioned as the first fully-fledged omnichannel Demand Side Platform (DSP) in the German market, designed to streamline and optimize digital advertising campaigns. Key features include support for a wide range of ad formats such as display, mobile, native, video, digital out-of-home (DOOH), cinema, digital audio, and programmatic TV. It offers automated, data-driven media buying capabilities, ensuring precision and efficiency in campaign execution.Requirements:5+ years of relevant development experienceProficient expertise in Java and Python;Proven experience in developing and maintaining distributed big data systems, with a focus on production-quality deployment and monitoring;Familiarity with high-performance data pipelines, ideally with technologies such as Apache Kafka and Apache Spark;Experience working with scheduling systems like Apache Airflow, as well as expertise in both SQL and NoSQL databases;Knowledge of cloud-based data platforms is a plus;Exposure to containerization tools like Docker and/or orchestration platforms such as Kubernetes is preferred;Clojure experience will be a great advantage;Comprehensive experience spanning the entire program development lifecycle, from conceiving features to deployment and ongoing monitoring.Responsibilities: Develop new data pipelines and maintain our data ecosystem, with a strong focus on fault-tolerant data ingestion, storage, and lifecycle management, as well as the computation of metrics, reports, and derived insights;Collaborate effectively with team members to develop software and innovative solutions that meet customer requirements;Write high-quality, reusable code, ensure thorough testing, and oversee the production deployment process;Apply industry best practices while fostering a culture of agility, continuous improvement, and excellence;Generate ideas and take an active role in the innovation process.Benefits:Office/remote work (from Spain)Competitive salaryLong-term projectsBusiness tripsProfessional growth (professional trainings, knowledge sharing meet-ups and etc)Career perspectivesTransparent and clear managementFriendly colleagues and atmosphereExtensive benefit package:- medical insurance,- compensation for external professional courses and trainings,- English and other language courses,- corporate gifts on special eventsCompany parties and team buildings;Flexible working hours (you can start till 11am, duration of working week is 40h);Nice corporate equipment (incl. second monitor);Comfortable well-equipped office in the city center (with kitchen, meeting rooms, etc.)