Data Engineer

Job Description:

The Data Engineer will perform the following tasks:
• Design, build, and maintain ETL/ELT pipelines.
• Automate data ingestion from various sources (databases, APIs, streaming services).
• Implement data validation and quality checks.
• Use platforms like Azure for cloud-based data solutions.
• Work with Data Scientists and Full stack Web Developers to provide clean, reliable data.
• Create and maintain comprehensive technical documentation, including user manuals, training materials, and product specifications, also developing functional specifications.
• Provide ongoing support for deployed pipelines including version control, data recovery processes, and deployment strategies.
• Research emerging technologies and industry trends, staying up to date with developments in the field, and actively assisting in testing and evaluating new products, tools, and technologies.

The Data Engineer is expected to fulfil the following deliverables:
• Completed project plan at project inception.
• Technical documentation and user manuals for assigned tasks, including dataflow and entity relationship diagrams.
• Progress reports with time sheets reflecting task fulfilment and project progress.
• Final source code, design assets, documentation and all related components to pipelines and applications are being developed.
• Other related deliverables as needed.

Qualifications

A minimum high school diploma with a certification or degree in Information Systems, Information Technology, Computer Science, Statistics or related area is required.

A minimum of 5+ years of professional experience with Python, SQL, cloud environments container orchestration (Kubernetes), and DevOps automation is required.

• Strong familiarity with semantic modelling, knowledge graphs, and AI/ML integration for data systems is desirable.
• Excellent analytical, problem-solving, and communication skills are required.
• Knowledge in database design, and development using MS SQL Relational Database is required.
• English and French are the working languages of the client; and Arabic is a working language of client.
• For this position, fluency in English is required.