Industry: E-commerce (Fashion & Home)
Location: Portugal
Work Model: 100% Remote
Assignment Type: B2B or Recibos Verdes
Start Date: ASAP
Project Language: English
Project Overview:Join a leading e-commerce company in fashion and home décor, as they undertake critical data engineering projects to support their evolving business needs. This is an exciting opportunity to contribute to high-impact data solutions for an innovative, customer-focused brand, leveraging the latest in data engineering best practices.
Responsibilities:Project Understanding and Communication:Analyze business and technical challenges from a user perspective.Collaborate with Data Architects and Project Managers to ensure solutions align with the client's data architecture.Data Pipeline Development:Design, build, and deploy efficient data pipelines according to project requirements.Apply best practices for performance, scalability, and maintainability.Use Terraform to deploy and manage infrastructure efficiently.Testing and Deployment:Define test cases and conduct testing in collaboration with the Project Manager.Present completed developments to Data Architects and Lead DataOps, ensuring smooth deployment and active monitoring post-deployment.Documentation and Peer Review:Document processes, tests, and results thoroughly.Conduct peer reviews and participate in code reviews for quality assurance.Requirements:Hard Skills:Google Cloud Platform: Solid understanding and at least 1 year of hands-on experience.Apache Airflow: Minimum 2 years of experience (Google Composer experience preferred).Google BigQuery: 2+ years with strong skills in optimization and database architecture design.Terraform: 1+ year of experience in infrastructure deployment.Optional:Experience with Apache Spark/PySpark, Google Pub/Sub, Kafka, Google Cloud Storage, or Dataflow (Apache Beam) is a plus.
Soft Skills:English Fluency: Strong written and verbal English skills in a working environment.Communication: Ability to convey technical concepts effectively and understand user needs.Organizational Skills: Detail-oriented with the ability to maintain structured documentation.Problem-Solving: Proactive approach to understanding and addressing data challenges.
#J-18808-Ljbffr