Senior Data Engineer (Portugal-Based Remote/Hybrid)

Detalhes da Vaga

\n What you'll be doing:Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;Work with complex data architectures, like Kappa and lambda architectures. You'll have the opportunity to work with batch and/or streaming processes;Have the opportunity to work with some of the most exciting and newest technologies in the data field;Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines. What you need to have:Strong experience with Python programming language;Previous experience in Software Engineering is considered;Very high level of SQL and data modelling expertise;Knowledge about other database types, like NoSQL databases is considered;Experience in cloud-based architectures, such as GCP and AWS;Experience with orchestration frameworks like Apache Airflow;Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements. What we would love to see:Knowledge of Data Governance;Experience with Modern Data Stack such as DBT, Bigquery;Experience with Kafka Ecosystem. E.g. Kafka, Kafka Connect, Schema Registry and others;Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;Capable of Zooming out and being able to propose changes to data architecture. To ensure you feel good solving a big Human problem, we offer:A stimulating, fast-paced environment with lots of room for creativity;A bright future at a promising high-tech startup company;Career development and growth, with a competitive salary;The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;A flexible environment where you can control your hours (remotely) with unlimited vacation; Access to our health and well-being program (digital therapist sessions);Remote or Hybrid work policy (Portugal only);To get to know more about our Tech Stack, check here.
\n* Please note that this position does not offer relocation assistance. Candidates must possess a valid EU visa and be based in Portugal.


Salário Nominal: A acordar

Fonte: Grabsjobs_Co

Função de trabalho:

Requisitos

Senior Qa Engineer (Mobile)

Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-sid...


Devexperts Llc - Porto

Publicado a month ago

Tech Lead

Universo is a financial institution leader in the issuance of credit cards in Portugal ("Cartão Universo") with more than 1 million customers. It has the goa...


Sonae - Porto

Publicado a month ago

It Service Desk Technician

We are seeking a skilled and proactive Service Desk Technician to provide exceptional technical support to our team. The ideal candidate will have experience...


Salt Services - Porto

Publicado a month ago

Scrum Master

The payments market is the most exciting technology market in the world today for good reason. McKinsey values it globally at over $2 trillion and it's growi...


Planet - Porto

Publicado a month ago

Built at: 2024-11-14T23:03:24.798Z