Job Title: Data Engineer Azure Data Lake Solutions
Location: Porto (mostly remote; office presence required 2-4 days a month)
Type: 12 months B2B Contract with possibility of extension
Job OverviewWe are seeking a skilled Data Engineer to design, build, and manage robust data lake solutions using Microsoft Azure technologies.
The ideal candidate will have a passion for working with complex datasets, enabling data-driven decisions and delivering scalable solutions that meet organizational goals.
Key ResponsibilitiesData Lake Development: Design, implement, and optimize data lake architectures to support data storage, processing, and analytics needs.Azure Ecosystem: Develop and manage solutions using Azure services such as Azure Data Lake, Azure Data Factory, Databricks, and Synapse Analytics.Data Integration: Create ETL/ELT pipelines to extract, transform, and load data from various structured and unstructured sources.Data Governance: Implement and maintain data quality, metadata management, and security standards in the data lake.Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand business needs and translate them into technical solutions.Performance Optimization: Monitor and fine-tune system performance for data processing workflows and ensure high availability.Documentation: Maintain comprehensive documentation of data architecture, processes, and workflows.QualificationsEducation: Bachelor's degree in Computer Science, Information Technology, or related field.
Master's degree is a plus.
ExperienceProven experience in data engineering roles with a focus on Azure-based solutions.Hands-on experience with Azure services such as Data Lake Storage, Data Factory, Synapse Analytics, and Databricks.Strong understanding of data lake architectures and principles.Technical SkillsProficiency in programming languages like Python, Scala, or Java.Expertise in SQL and database management.Familiarity with big data frameworks such as Hadoop or Spark.Experience with data modeling and building data pipelines.Knowledge of version control tools (e.g., Git) and CI/CD pipelines.Soft SkillsStrong problem-solving skills and attention to detail.Excellent communication and collaboration skills.Ability to work in a fast-paced, dynamic environment.Keywords: Azure, Data Lake, Azure Data Factory, SQL
#J-18808-Ljbffr