Data Engineer / Devops

Detalhes da Vaga

Explore our latest thought leadership, ideas, and insights on the issues that are shaping the future of business and society.
Choose a partner with intimate knowledge of your industry and first-hand experience of defining its future.
Discover our portfolio – constantly evolving to keep pace with the ever-changing needs of our clients.
Become part of a diverse collective of free-thinkers, entrepreneurs and experts – and help us to make a difference.
See our latest news, and stories from across the business, and explore our archives.
We are a global leader in partnering with companies to transform and manage their business by harnessing the power of technology.
At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and engineering services across all industries. Join us for a career full of opportunities. Where you can make a difference. Where no two days are the same.
Your roleWe are seeking a skilled Data Engineer to join our dynamic team. The ideal candidate will be responsible for developing, maintaining, and optimizing our data pipeline architecture while ensuring the availability and performance of critical data workflows. If you are passionate about data engineering, have hands-on experience with cloud platforms and big data technologies, and are a strong problem-solver, this is the role for you.
Design, build, and maintain scalable, efficient, and reliable data pipelines to support data processing and analytics;Implement best practices in Big Data tools and frameworks, ensuring data integrity and performance;Collaborate with cross-functional teams to integrate new data sources and optimize data pipelines;Work with complex datasets, ensuring data quality, transformation, and storage in BigQuery;Troubleshoot data pipeline issues and implement long-term solutions to improve system stability;Write and optimize complex SQL queries for data extraction and analysis;Utilize Kafka for real-time data streaming and event-driven architecture;Implement solutions using Python for data processing and ETL workflows;Perform code reviews and maintain high-quality code standards.Your profileProficiency in BigQuery with 3+ years of experience;3+ years of experience of Spark in large-scale data processing;3+ years of experience of SQL in writing and optimizing complex queries;Advanced proficiency in Python with 4+ years of experience in scripting and automation;2+ years of experience of Kafka with real-time data streaming;Effective communication in English, both verbal and written.Nice to Have:
Experience with Google Dataflow and Google Dataproc for managing data pipelines in GCP;Knowledge of Scala for parallel data processing;Familiarity with Hadoop for distributed storage and processing of big data.What you'll love about working hereJoin a multicultural and inclusive team environment;Enjoy a supportive atmosphere promoting work-life balance;Engage in exciting national and international projects;Your career growth is central to our mission. Our array of career growth programs and diverse professionals are crafted to support you in exploring a world of opportunities;Training and certifications programs;Referral program with bonuses for talent recommendations;Great office locations.Why Capgemini?Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of technology and build a more sustainable, more inclusive world.
Apply now!

#J-18808-Ljbffr


Salário Nominal: A acordar

Fonte: Jobleads

Função de trabalho:

Requisitos

Scrum Master

Created in 2015 in a technology disruption group, Powertalent is a Portuguese company specializing in TI projects. Our experience allows us to succeed where ...


Powertalent - Lisboa

Publicado 8 days ago

Embedded Software Engineer

Job Description Your contribution to something big:    Developing a high-performance and robust software in the field of interior monitoring cameras Checking...


Bosch Group - Lisboa

Publicado 8 days ago

Back End Web Developer (Java Golang)

Noesis is looking for candidates with the following profile: Degree in Computer Engineering or similar; Minimum of 3 years of professional experience in deve...


Noesis - Lisboa

Publicado 23 days ago

Application Production Support

Main Responsibilities: Manage incidents according to Service Delivery GITSDE / ITIL Standard; Monitor environments and KPIs, suggest changes, improvements so...


Noesis - Lisboa

Publicado 23 days ago

Built at: 2024-11-24T10:42:35.187Z