What you'll be doing:
Design, build and maintain ETL/ELT data pipeline that ingests data from multiple sources with different technologies (MySQL, BigQuery, Cloud Storage, CSV, FHIR, JSON, etc.);
Architect and maintain Sword's (complex) data warehouse; We own lots of different types of data;
Work with complex data architectures, like Kappa and lambda architectures. You'll have the opportunity to work with batch and/or streaming processes;
Have the opportunity to work with some of the most exciting and newest technologies in the data field;
Work closely with our Algorithms and AI teams, supporting their needs for data and pipelines.
What you need to have:
Strong experience with Python programming language;
Previous experience in Software Engineering is considered;
Very high level of SQL and data modelling expertise;
Knowledge about other database types, like NoSQL databases is considered;
Experience in cloud-based architectures, such as GCP and AWS;
Experience with orchestration frameworks like Apache Airflow;
Proactivity and capability of proposing improvements to the team, being technical improvements or processual improvements.
What we would love to see:
Knowledge of Data Governance;
Experience with Modern Data Stack such as DBT, Bigquery;
Experience with Kafka Ecosystem: Kafka, Kafka Connect, Schema Registry and others;
Experience with IaC (Terraform), Containerization (Docker, Kubernetes) and CI/CD;
Capable of Zooming out and being able to propose changes to data architecture.
To ensure you feel good solving a big Human problem, we offer:
A stimulating, fast-paced environment with lots of room for creativity;
A bright future at a promising high-tech startup company;
Career development and growth, with a competitive salary;
The opportunity to work with a talented team and to add real value to an innovative solution with the potential to change the future of healthcare;
A flexible environment where you can control your hours (remotely) with unlimited vacation;
Access to our health and well-being program (digital therapist sessions);
Remote or Hybrid work policy (Portugal only);
#J-18808-Ljbffr