Avaron AB - Logo

Senior Data Engineer – Data Lake & ETL (Python/Apache Iceberg/Spark)

Avaron AB

Stockholms län, Solna

Previous experience is desired

8 days left
to apply for the job

About the Company

At Avaron, you enjoy the security of a permanent position combined with the variety of working on-site at different clients. We recruit specialists in everything from technology, IT, and industry to project management and business support – and regardless of the assignment, you have a consultant manager who is there for you and your development.

About the Role

You will play a key role in the further development of a Data Lake platform and research infrastructure within an advanced healthcare and research environment. Here, data becomes an enabler for better decisions, higher quality, and safer processes in a business where accessibility, traceability, and correct handling of sensitive information are crucial.

You will step into an active development phase where you quickly take ownership of existing architecture and ongoing implementation. The environment is technically complex and is based on metadata-driven ETL design, Apache Iceberg, Spark, Trino, and OpenShift. This role is perfect for you who want to combine heavy technical development with a context where solutions make a real difference for healthcare and research.

Responsibilities
  • You finalize and further develop a metadata-driven ETL pipeline framework for a research platform.
  • You develop data pipelines, backend services, and integrations with clinical source systems and databases.
  • You maintain and further develop the Data Lake architecture using Apache Iceberg, Spark, and Trino.
  • You ensure correct handling and anonymization of sensitive clinical data in accordance with current regulations.
  • You build robust solutions on OpenShift with a focus on automation, test-driven development, and code review.
  • You work closely with developers, product owners, and architects to create scalable and long-term sustainable solutions.
Requirements
  • An academic degree in Computer Science, System Development, or equivalent documented experience.
  • At least 5 years of experience in system development with Python as the main language, focusing on data pipelines, backend services, and system integration.
  • At least 3 years of experience in ETL/ELT development towards SQL databases and object storage.
  • At least 3 years of experience with event-driven architecture and async message handling using Kafka, RabbitMQ, or equivalent.
  • At least 3 years of experience working with container platforms such as Kubernetes/OpenShift and CI/CD solutions.
  • At least 2 years of experience with distributed data processing using Apache Spark, including integration with Data Lake platforms.
  • Documented experience with Apache Iceberg or Delta Lake as an open table format in a production environment.
  • Documented experience with metadata-driven ETL design and pipeline frameworks in a production environment.
  • Documented experience with PII anonymization, encryption, or hashing of sensitive clinical data in compliance with regulatory requirements in a production environment.
  • Documented experience with Trino or equivalent distributed SQL query engine against a Data Lake in a production environment.
  • Ability to collaborate with both technical and business-oriented teams.
  • Fluent in Swedish and English, both written and spoken.
Merits
  • Experience developing data pipelines or data processing services for large datasets in publicly funded healthcare or research activities involving clinical data.
  • Experience taking independent responsibility for the design and implementation of Data Lake architecture with open table formats in environments handling clinical data.
  • Experience with monitoring, logging, and alerting in production environments, e.g., using Datadog, CloudWatch, or equivalent.
  • Experience designing and implementing test and quality assurance frameworks for data pipelines in production environments, e.g., using pytest, Robot Framework, dbt testing, or equivalent.
  • Experience implementing security solutions for systems handling sensitive data, e.g., secrets management, audit logging, or access controls.
We Offer
  • Permanent employment at Avaron AB
  • Occupational pension
  • Wellness allowance of 5,000 SEK per year
Application

We are recruiting continuously – please apply as soon as possible.

🖐 Was this job fit for someone?
Share

Other jobs in the same field

Maybe it’s time to broaden the search with these available jobs

Keyword / Occupation
Similar jobs
Latest posts
  • National Debt - National Debt – Level, GDP Share, and Development to 2026
    Mon, 8 Jun 2026 - 09:59
  • Public Opinion - SCB Opinion Poll June 2026 – Social Democrats Drop
    Thu, 4 Jun 2026 - 14:35
  • Inflation - Inflation May 2026 – KPIF Rises to 1.5 Percent
    Thu, 4 Jun 2026 - 08:30
  • Promocode - Up to 25% off experiences for mom – Celebrate Mother’s Day with Live it
    Tue, 26 May 2026 - 12:00
  • Tips - Create a Professional Website with AI - That's Why I Built Deffe.com
    Tue, 19 May 2026 - 22:28
  • Municipality -
    Tue, 19 May 2026 - 00:35