Data Engineer
Empresa:

Zerog - Ai In Aviation


Lugar:

Portugal


Função de trabalho:

Tecnologia da informação

Detalhes da Vaga

.You'll be focused in - Managing the data architecture for data ingestion, pipeline setup and data curation; - Creating and maintaining data pipeline architecture; - Building the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies; - Developing, testing, documenting and coordinate technical, functional and non functional requirements for newly developed features, functionalities or interfaces of a global data lake; - Deriving of technicaluser stories from solution concepts; - Implementation of user stories as part of Scrum Sprints as an integral part of the development team; - Present results in working meetings and workshops. In order to succeed, you'll need - Bachelor's degree in computer science, software engineering, or comparable work experience; - Proven experience working as a Data Engineer or related role; - Experience building and optimizing 'big data' data pipelines, architectures, and data sets; - Experience building processes supporting data transformation, data structures, metadata, dependency, and workload management; - Strong knowledge of Cloud-based technologies, Infrastructure as Code and DevOps cycle tools (e.G. Terraform or CDK, Jenkins and Kubernetes); - Strong communication and analytical skills; - Great English skills,both written and spoken. Nice to have - Experience of AWS Cloud (SQS, S3, EC2, Step Functions, Lambda, EFS, Cloudformation, Sagemaker Notebooks, EMR, Cognito,Glue and Athena); - Experience with Git, Jira and Confluence; About the product Volkswagen Commercial Vehicles (VWN) is involved in the development and operation of a VWN measurement data management and analytics system. The aim of the system is to provide all brand departments with analysis tooling to process measurement data collected from R&D and QA test vehicles using data logger technology to optimize existing products and processes and to develop new data-driven digital products


Fonte: Jobtome_Ppc

Função de trabalho:

Requisitos

Data Engineer
Empresa:

Zerog - Ai In Aviation


Lugar:

Portugal


Função de trabalho:

Tecnologia da informação

Job In Germany: Intune Consultant (M/W/D) Im Device-Management

Intune Consultant (m/f/d) in device management Permanent position, full-time - Cologne Your tasks The device management team looks after over 120,000 end dev...


Desde Netcologne It Services Gmbh - Portugal

Publicado a month ago

Job In Germany: End User Services Engineer (F/M/D)

Design. Progress. Together. CureVac Corporate Services GmbH, a wholly owned subsidiary of CureVac SE, combines the central functions of the CureVac business ...


Desde Curevac Corporate Services Gmbh - Portugal

Publicado a month ago

Job In Germany: Programmer (M/F/D)

Programmer (m/f/d) You do like to make a impress the job? Then join us programmer (m/f/d) in Mühlhausen/Thür. What you can expect: Coding applications ...


Desde Thüringer Papierwarenfabrik C. Schröter Gmbh & Co. Kg - Portugal

Publicado a month ago

Job In Germany: Linux System Administrator (M/F/D)

Linux System Administrator (m/f/d) Permanent position, full-time - Cologne Your tasks Setup and operation of centralized and decentralized Linux systems The ...


Desde Netcologne It Services Gmbh - Portugal

Publicado a month ago

Built at: 2024-07-03T08:38:10.448Z