ACT DIGITAL
Job Description
WORKING METHODS, ENVIRONMENT AND CONDITIONS
- Project duration: 600 days
- Initial contract duration: 220 days
- Expected start date: ASAP
- Service delivery mode: Near-Site / Hybrid in Brussels, Belgium
SPECIFIC EXPERTISE
Following specific expertise is mandatory for the performance of tasks:
-
- at least 5 years of excellent knowledge in Azure data lake storage and Oracle databases
- at least 5 years of excellent expertise in developing data pipelines from REST APIs and on integration (such as Python, Azure Synapse, SQL)
- at least 5 years of excellent expertise in processing JSON and GIS data
CERTIFICATIONS & STANDARDS:
Following certificates & standards are mandatory for the performance of tasks:
- Microsoft Certified: Azure Data Engineer Associate
Following certifications are a plus:
- Microsoft Certified: Azure Solutions Architect Expert
- Microsoft Certified: Azure Developer Associate
- Microsoft Certified: Azure Database Administrator Associate
KNOWLEDGE AND SKILLS
Following skills and knowledge are required for the performance of the above listed tasks:
-
- Excellent knowledge of data engineering tools such as Python and Azure Synapse Analytics
- Excellent knowledge of working with REST APIs, including ingestion and parsing of JSON and GIS data
- Excellent knowledge of Azure data lake storage and Oracle database
- Ability to implement robust data quality checks, logging, and monitoring in ETL processes
- Ability to document ETL workflows, metadata, and technical specifications clearly and consistently
- Familiarity with DevOps and version control best practices. Experience with CI/CD pipelines
- Analysis and problem solving skills
- Ability to participate in technical meetings and good communication skills
DESCRIPTION OF THE TASKS
Following tasks will be performed by external service provider:
-
- Develop, deploy, and maintain scalable data pipelines from REST APIs using Python, SQL, and ETL tools (Azure Synapse) to ingest, transform, and prepare data.
- Process and transform complex JSON and GIS data into structured datasets optimized for analysis and reporting. This includes parsing, transforming, and validating JSON data to ensure data quality and consistency.
- Load and organize processed data into cloud-based Azure Data Lake storage ensuring accessibility and performance.
- Document ETL processes, metadata definitions, data lineage, and technical specifications to ensure transparency and reusability.
- Collaborate with data analysts, BI developers, and business stakeholders to understand data requirements and deliver reliable, well-documented datasets aligned with organizational needs.
- Implement data quality checks, logging, and monitoring within data pipelines to support maintainability and troubleshooting.
Qualifications
A minimum educational qualification for lot 3 is: Level of education corresponding to Level 7 of the European Qualification Framework which typically corresponds to a master degree of 5 years, in Computer Science and/or Software Engineering.
Solliciteren