DATA ENGINEER
DATA ENGINEER
Open-ended contract
Mission
Hybrid work mode in Madrid
The main responsibilities are
- Lead the design, development, and maintenance of scalable data pipelines and systems and guidelines according to the customers’ needs.
- Collaborate with cross-functional teams to understand data requirements and deliver solutions.
- Ensure the performance, security of the data infrastructure and the data quality/integrity. It is essential to follow the best practice of Data engineering.
- Optimize data workflows for performance and efficiency to enrich and transform large volumes of data with complex business rules.
- Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
- Designing and implementing scalable and secure data processing pipelines using Scala, Spark, Cloud Object Storage (COS).
- Set up CI/CD pipelines to automate deployments, unit testing and development management.
- Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
- Write technical documentation (specifications and operational documents) to ensure knowledge capitalization.
- Support the different teams in troubleshoot and resolution of data-related issues.
- Assure the creation and maintenance of comprehensive documentation of data pipelines, systems, and processes, being accessible to the team members
- Effective communication with team members and stakeholders to ensure alignment on data initiatives.
- Provide technical guidance and mentorship to junior data engineers.
- Foster a culture of continuous learning and improvement within the team.
Profile
Good knowledge of
- Spark on Scala
- CI/CD tools (Gitlab, Jenkins…)
- S3 storage / COS and parque format
- Strong Knowledge of SQL and NoSQL databases
- Hadoop
- Apache Airflow
Full understanding of
- Shell script
- Software Development Lifecycle (SDLC) awareness
- Agile principles and ceremonies
- Kubernetes containerization
- Elasticsearch and Kibana
Optionally/ as a plus [*]
- HVault
- Dataiku
- Dremio as tool to virtualize data
BUSINESS AND TRANSVERSAL SKILLS
- Knowledge of banking industry and processes
- Excellent Problem-Solving skills and attention to detail
- Decision-Making person
- Business / IT relationship (including IT OPS)
- Strong communication and interpersonal skills.
- Ability to understand, explain and support change
- Ability to Deliver / Results driven
- Continuous learning and improvement
LANGUAGES
- English level B2 or higher
- Optionally, French level B1
Organization
🚀 Join Inetum – We're Hiring a DATA ENGINEER! 🚀
At Inetum, a leading international digital consultancy, we empower 27,000 professionals across 27 countries to shape their careers, foster innovation, and achieve work-life balance. Proudly certified as a Top Employer Europe 2024, we’re passionate about creating positive and impactful digital solutions.