Euronext | Senior Data Engineer (m/f) Referencia: JN -112024-6581020
Adicionado em 04.11.2024
Sobre os nossos clientes
Euronext is the leading pan-European market infrastructure, shaping capital markets for future generations. Its mission is to connect European economies to global capital markets, to accelerate innovation and sustainable growth. Euronext is located in 18 countries across Europe, US and Asia, with regulated exchanges in Belgium, France, Ireland, Italy, the Netherlands, Norway and Portugal. The group has expanded organically and externally, with a revenue growing from €458 million in 2014 to €1.5 billion in 2022, with 2,200 employees and 55 nationalities.
Descriçao da oferta
Our client, Euronext, is recruiting a Senior Data Engineer to join an international team.
Description
Data Modeling: Designing efficient data models for optimal query performance.
SQL Proficiency: Writing and optimizing SQL queries.
Performance Tuning: Identifying and optimizing performance bottlenecks.
ETL and Data Integration: Extracting, transforming, and loading data into Redshift, MySQL, PostgreSQL.
Cluster Management: Provisioning, scaling, and monitoring Redshift clusters.
Security and Compliance: Implementing security measures and ensuring compliance.
AWS Integration: Integrating Redshift with other AWS services.
Monitoring and Troubleshooting: Monitoring cluster performance and resolving issues.
Documentation and Training: Creating documentation and providing training to team members.
Logging and Tracing: Proficiency in setting up and managing logging and tracing mechanisms in AWS, including leveraging services like AWS CloudTrail for auditing API calls and AWS X-Ray for distributed tracing and performance analysis. Understanding of best practices for logging configuration, log aggregation, and analysis to ensure visibility into system activity and troubleshooting capabilities.
Profile
Expertise in AWS: Extensive experience with AWS services, particularly Lambda, Glue, Step Functions, CloudFormation, CloudWatch, and others.
Strong Solution Architecture Knowledge: Ability to design scalable and efficient data solutions on AWS, considering best practices for cloud architecture and infrastructure.
Proficiency in Python and Databases: Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, RedShift) and NoSQL databases.
Orchestration and Workflow Management: Experience with orchestration tools such as Apache Airflow and AWS Step Functions for automating and managing data workflows.
ETL Tools and Big Data Experience: Knowledge of ETL tools and experience working with large volumes of data, with a preference for Kafka experience.
Experience with Iceberg Tables: Familiarity with Iceberg tables for managing large datasets efficiently, ensuring data consistency, and supporting ACID transactions.
Production Awareness and Troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.
Technical Leadership and Communication: Capable of evolving into a technical lead role, with excellent communication and teamwork skills to collaborate effectively with cross-functional teams.
Strong Analytical and Problem-Solving Skills: Ability to analyze requirements, define technical approaches, and propose innovative solutions to complex problems.
Documentation and Requirements Analysis: Experience in writing solution documents, technical documentation, and the ability to challenge and refine business requirements.
Job Offer
A good opportunity to ramp up a global project.
#J-18808-Ljbffr