Ryanair Labs is the technology brand of Ryanair, a start-up inside a corporation and a state of-the-art digital & IT innovation hub creating Europe’s Leading Travel Experience for customers.
More than 600+ IT enthusiasts are working on 30+ projects with a collaboration of our Dublin, Madrid, Wroclaw and Portugal Labs teams and are making your travel experience unique.
As a result of our continued expansion, we want to hear from the best IT experts the European spanet has to offer to join our Labs.

The Role

We are looking for a Data Engineer to work in a multi-disciplined team, working alongside Developers, Designers and Product Owners, who will own their work from the initial idea to the final implementation. We are continually gathering information on travel related events and are looking for someone to help us make the most of a cloud based data system. The role will allow for opportunities to work in a variety of areas such as commercial, spaneting, engineering, logistics, and anything else that you may think of, or that will come your way.

Your tasks will include

• Creation of automated ELT processes ensuring a high level of data quality and reliability, using data processing tools such as Spark, Apache Airflow, DBT, Python, Databricks, etc.
• Data processing, both in batch and real-time, using Apache Kafka and other AWS cloud services like SNS, SQS, or Kinesis, creating microservice architectures.
• Maintenance of the data lake in AWS and Databricks, designing well governed query oriented data models for efficient consumption.
• Creation and use of monitoring plans for proper observability.
• Assisting other teams in the search, collection, and processing of valuable information for different business cases.
• Support for the Data Science team, creating environments for their models that ensures reliable and efficient resource usage.
• Creation of CICD pipelines to ensure automatic deployment with eventual consistency.
• Administration and maintenance of the deployed infrastructure.
• Creation of standards and best practices within the Data Engineering team.

Our Tech Stack:

• Batch processing with DBT on Databricks, Python on AWS Batch, Python on AWS Lambdas
• Virtualization through Docker and AWS ECR
• Orchestration with Airflow
• Event driven solutions with SNS, SQS, DynamoDB, Lambdas, Kinesis and Kafka streams
• Data Warehouse on Databricks
• Monitoring with Grafana and New Relic
• IaaC with Cloudformation and Terraform
• CICD Pipelines with Bitbucket + Codestar + Codebuild + Codepipeline.
• Programming languages: Python, Scala
• Git as CVS, JIRA Kanban boards as teamwork organization
  

Experience:

• +4 years of experience working on data processing related projects (ETLs, Data Analysis, etc…).
• Working on extracting information from multiple data formats (file formats, Json, CSV, parquet etc…; APIs, different DB engines..)
• Experience in Data Modelling on analytical data bases in Big Data ecosystems (Databricks, Glue, Snowflake or similar).
• Experience on event driven architectures. Preferably on AWS.
• +2 years at least working on AWS. Experience with the following services:
• Core AWS Services: IAM, S3, EC2, VPC etc…
• AWS Data Services: EMR, Batch, Lambda, SNS, SQS, DynamoDB, Glue, Athena
• Experience on defining process monitoring, alerting and troubleshooting.
• Experience working with Data Science teams, productionizing their pipelines and assisting them for data wrangling and reporting.

Knowledge

• Strong knowledge on general computing systems (OS, network, memory, processes, etc).
• Proficient in data analysis.
• Good intuition in exploring data and interpretation.
• Decent math / statistical base skills and how to use them on data quality processes.
• Good knowledge of Data Warehouse concepts.
• Proficient on SQL. Being able to optimize queries and understand the underneath process.
• Deep knowledge of Big Data technologies, especially on HDFS/ Object Storage and Spark.
• Proficient on data processing with Python and optionally Scala. Knowing how to use the proper library for each use case.
• Proficient coding skills, being able to build solutions using well known design patterns, following best practices and proficient testing skills.
• Docker virtualization. Experience with Kubernetes as well.
• Job Orchestration with Airflow or similar.
• Good knowledge of IaaC and CICD principles.
• Good storytelling and data visualization skills through dashboards.

Other:

• Good communication skills.
• Proactivity and good team spirit.
  

• We promote innovation, all our teams are Agile and several PoCs of new technologies or innovative ideas are launched every week.
• A competitive but flexible technical career plan.
• We believe in an hybrid working model, you can work up to three days per week remote, but you are also going to enjoy the excellent work environment at our modern offices in the heart of Madrid or Wroclaw.
• Optional discounts on health insurances (various companies).
• Travel discounts, of course!.