DATA ENGINEER

DATA ENGINEER

Contrato sem Termo

Mission

Hybrid work mode in Madrid

 

The main responsibilities are

  • Lead the design, development, and maintenance of scalable data pipelines and systems and guidelines according to the customers’ needs.
  • Collaborate with cross-functional teams to understand data requirements and deliver solutions.
  • Ensure the performance, security of the data infrastructure and the data quality/integrity. It is essential to follow the best practice of Data engineering.
  • Optimize data workflows for performance and efficiency to enrich and transform large volumes of data with complex business rules.
  • Automate data pipelines and streamline data ingestion through the implementation of different orchestrators and scheduling processes (Airflow as a Service mainly).
  • Designing and implementing scalable and secure data processing pipelines using Scala, Spark, Cloud Object Storage (COS).
  • Set up CI/CD pipelines to automate deployments, unit testing and development management.
  • Write and conduct unit and validation tests to ensure accuracy and integrity of code developed.
  • Write technical documentation (specifications and operational documents) to ensure knowledge capitalization.
  • Support the different teams in troubleshoot and resolution of data-related issues.
  • Assure the creation and maintenance of comprehensive documentation of data pipelines, systems, and processes, being accessible to the team members
  • Effective communication with team members and stakeholders to ensure alignment on data initiatives.
  • Provide technical guidance and mentorship to junior data engineers.
  • Foster a culture of continuous learning and improvement within the team.

Perfil

Good knowledge of

  • Spark on Scala
  • CI/CD tools (Gitlab, Jenkins…)
  • S3 storage / COS and parque format
  • Strong Knowledge of SQL and NoSQL databases
  • Hadoop
  • Apache Airflow

Full understanding of

  • Shell script
  • Software Development Lifecycle (SDLC) awareness
  • Agile principles and ceremonies
  • Kubernetes containerization
  • Elasticsearch and Kibana

Optionally/ as a plus [*]

  • HVault
  • Dataiku
  • Dremio as tool to virtualize data

 

BUSINESS AND TRANSVERSAL SKILLS

  • Knowledge of banking industry and processes
  • Excellent Problem-Solving skills and attention to detail
  • Decision-Making person
  • Business / IT relationship (including IT OPS)
  • Strong communication and interpersonal skills.
  • Ability to understand, explain and support change
  • Ability to Deliver / Results driven
  • Continuous learning and improvement

LANGUAGES

  • English level B2 or higher
  • Optionally, French level B1

Organização

🚀 Join Inetum – We're Hiring a DATA ENGINEER! 🚀

At Inetum, a leading international digital consultancy, we empower 27,000 professionals across 27 countries to shape their careers, foster innovation, and achieve work-life balance. Proudly certified as a Top Employer Europe 2024, we’re passionate about creating positive and impactful digital solutions.

País

Espanha

Localização

Madrid

Tipo de contrato

Contrato sem Termo

Aplicar