مهندس بيانات ضخمة

• Design and develop Big Data architectures according to business and technical needs.
• To develop, maintain and optimize robust and industrialized ETL/ELT pipelines.
• Collect and integrate data from various sources: databases, APIs, files, business applications, logs, IoT, etc.
• Set up and maintain batch and streaming processing workflows.
• Develop and optimize distributed processing on large volumes of data.
• Design and maintain data storage and processing solutions, including Data Lakes and Data Warehouses.
• Structuring, transforming and preparing data for analytical, BI and Machine Learning needs.
• Implement mechanisms for data control, validation, cleaning and transformation.
• To guarantee the quality, integrity, consistency and traceability of data.
• Optimize the performance of Big Data pipelines, queries, processing and infrastructure.
• Implement solutions for supervision, monitoring, alerting and incident management.
• Automate the deployment, execution, and monitoring of data pipelines.
• Participate in the implementation and improvement of CI/CD and DataOps practices.
• Collaborating with Data Scientists to prepare and make available the data necessary for analytical and Machine Learning models.
• Collaborating with Data Analysts and business teams to meet data and reporting needs.
• Integrate new technologies and Big Data solutions according to the company's needs.
• Conduct POC (Proof of Concept) projects to evaluate new technologies, architectures or solutions.
• Participate in resolving critical incidents related to data flows and platforms

Desired Candidate Profile

• Basic Training: University degree (Engineering/Master's 2) BAC +5 Specialization in Computer Science, Telecommunications, Electronics, Statistics, Operations Research, Artificial Intelligence or Data Science
• Experience in a similar position.