Senior Data Engineer (Portugal-Based Remote/Hybrid)

Detalhes da Vaga

What you'll be doing:

Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);
Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;
Work with complex data architectures, like Kappa and lambda architectures. You'll have the opportunity to work with batch and/or streaming processes;
Have the opportunity to work with some of the most exciting and newest technologies in the data field;
Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.
What you need to have:

Strong experience with Python programming language;
Previous experience in Software Engineering is considered;
Very high level of SQL and data modelling expertise;
Knowledge about other database types, like NoSQL databases is considered;
Experience in cloud-based architectures, such as GCP and AWS;
Experience with orchestration frameworks like Apache Airflow;
Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.
What we would love to see:

Knowledge of Data Governance;
Experience with Modern Data Stack such asDBT,Bigquery;
Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;
Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;
Capable of Zooming out and being able to propose changes to data architecture.
To ensure you feel good solving a big Human problem, we offer:

A stimulating, fast-paced environment with lots of room for creativity;
A bright future at a promising high-tech startup company;
Career development and growth, with a competitive salary;
The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;
A flexible environment where you can control your hours (remotely) with unlimited vacation;
Access to our health and well-being program (digital therapist sessions);
Remote or Hybrid work policy (Portugal only);
To get to know more about our Tech Stack, checkhere.
* Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.


Salário Nominal: A acordar

Fonte: Lever_Co

Função de trabalho:

Requisitos

Senior Data Engineer

.The payments market is the most exciting technology market in the world today for good reason. McKinsey values it globally at over $2 trillion and it's grow...


Planet Paymet - Porto

Publicado a month ago

Administrador(A) De Sistemas & Pré-Vendas

Administrador(a) de Sistemas & Pré-vendasEstás à procura de uma oportunidade para integrar um projeto de telecomunicações líder no mercado B2B? Queres fazer ...


Dellent Consulting - Porto

Publicado a month ago

Accessibility Qa Engineer

Accessibility QA Engineer - Devexperts CareerCompany DescriptionDevexperts has been working for nearly two decades consulting and developing for the financia...


Devexperts Llc - Porto

Publicado a month ago

Redhat Openshift Platform Administrator (M/F) – Hybrid (Porto)

Match Profiler is an Information Systems consulting firm, working in the national and international market since 1999. We are empowered with multidisciplinar...


Match Profiler - Porto

Publicado a month ago

Built at: 2024-11-13T12:21:27.141Z