Vacant job

Data Engineer (Databricks)

Permanent position at JP IT-Konsult i Stockholm AB – Assignment in Gothenburg

About the company

JP IT-Konsult i Stockholm AB is a well-established consulting company passionate about finding and developing the digital talents of the future. Our ambition is to create value for both our employees and clients by offering exciting assignments and good development opportunities. We are now looking for a Data Engineer with solid experience in Databricks for a long-term consulting assignment with an exciting client in Gothenburg. The assignment is expected to start in January 2025 and last until October 2026, with a partially flexible workplace (approximately 25% remote).

Responsibilities

In the role of Data Engineer, you will:

• Design and drive scalable data flows using Databricks, including ETL/ELT processes.
• Collaborate with development and product teams to integrate data from multiple sources and optimize and maintain a stable data platform.
• Implement and monitor procedures for data monitoring, quality assurance, and security.
• Optimize data flows and ensure that the architecture follows best practices for performance and protection.
• Utilize features such as Delta Lake and Databricks Workflows to maximize platform stability and reliability.
• Work with cloud infrastructure to ensure platform availability and scalability.

Qualifications (Must-haves)

We are looking for someone who has:

• At least 5 years of experience working as a Data Engineer or in a similar role.
• At least 2 years of practical experience using Databricks in larger projects.
• Good knowledge of IaC, CI/CD pipelines, version control (Git), and DevOps principles related to data flows.
• High competence in Databricks, including tools such as Delta Lake, Databricks Jobs, and Databricks SQL.
• Very good skills in Python for data management and pipeline development.
• Experience with Apache Spark, large datasets, and distributed data technologies (e.g., Hadoop or Kafka).
• Knowledge of medallion architecture in Databricks and automated testing and data quality frameworks.
• Professional level in English, both spoken and written.

Preferred Qualifications (Nice to have)

• Experience with Azure infrastructure (e.g., ADF, Blob Storage, DataLake).
• Familiarity with agile methodologies in a product-oriented organization.
• Understanding of or practical experience with data mesh concepts.
• Knowledge of Terraform and/or Bicep.
• Experience with streaming ETL solutions.
• Insight into SLO, GitHub, and various types of control plans.

Application

Does this sound exciting? Send your application today to [email protected] and include ”Data Engineer (Databricks)” in the subject line. We are reviewing applications on an ongoing basis, so don’t hesitate to reach out if you are interested in joining us on our journey!

We warmly welcome your application!

(This is a permanent position at JP IT-Konsult i Stockholm AB, where you will work as a consultant on a long-term assignment with the client in Gothenburg.)