Data Driven | Data Engineer Apache Flink

Detalhes da Vaga

Job Description We are looking for an expert in Apache Flink professional service.
As an Apache Flink expert, the professional will be responsible for developing and maintaining Flink applications, optimizing performance, and troubleshooting any issues that arise.
The expert should have a deep understanding of stream processing and batch processing using Apache Flink.
Strong programming skills in Java or Scala are required.
Experience with other big data technologies such as Hadoop and Spark is a plus.
Key Responsibilities: Develop and Deploy Flink Applications • Complete a fully functional set of Flink applications for both batch and stream processing, integrated with required data sources.
Performance Optimization • Deliver optimized Flink pipelines, tuned for performance and resource efficiency, with benchmarks and reports on improvements made.
Flink Cluster Setup • Deploy and configure a production-ready Flink cluster, ensuring it's optimized for scalability and fault tolerance.
Monitoring and Alerting Setup • Implement a monitoring system (e.g., Prometheus, Grafana) to track application performance and set up alerting for critical issues.
Issue Resolution • Provide a report on all identified and resolved Flink-related issues, including performance bottlenecks and job failures.
Documentation • Hand over detailed documentation covering application architecture, performance tuning, troubleshooting procedures, and operational best practices.
Final Knowledge Transfer • Conduct a final knowledge transfer session with the internal team, ensuring they are fully capable of maintaining and expanding on the delivered Flink setup.
Qualifications • Expertise in Apache Flink • Strong programming skills in Java or Scala and SQL • Knowledge of stream processing and batch processing • Familiarity with big data technologies like Hadoop and Spark • AWS data services • Proven experience with projects in Flink production Java or Scala and SQL • Experience with Hadoop and Spark Additional Information The Devoteam Group works for equal opportunities, promoting its employees based on merit and actively fights against all forms of discrimination.
We are convinced that diversity contributes to the creativity, dynamism and excellence of our organization.
All of our vacancies are open to people with disabilities.


Salário Nominal: A acordar

Fonte: Talent_Ppc

Função de trabalho:

Requisitos

Senior Qa Engineer (Mobile)

Devexperts works with respected financial institutions, delivering products and tailor-made solutions for retail and brokerage houses, exchanges, and buy-sid...


Devexperts Llc - Porto

Publicado a month ago

Tech Lead

Universo is a financial institution leader in the issuance of credit cards in Portugal ("Cartão Universo") with more than 1 million customers. It has the goa...


Sonae - Porto

Publicado a month ago

It Service Desk Technician

We are seeking a skilled and proactive Service Desk Technician to provide exceptional technical support to our team. The ideal candidate will have experience...


Salt Services - Porto

Publicado a month ago

Scrum Master

The payments market is the most exciting technology market in the world today for good reason. McKinsey values it globally at over $2 trillion and it's growi...


Planet - Porto

Publicado a month ago

Built at: 2024-11-15T01:54:45.723Z