Polcode
dodano: 29 godzin temu9Wyświetleń
Data Engineer (Databricks) | Enterprise Energy Data Platform
Miejsce Pracy
Warszawa+Hybrydowo
wynagrodzenie
110-150 PLN / h
SQLPythonAzure
- Znajomość jezyka
- angielski
- Typ oferty
- Działalność gospodarcza
- Doświadczenie
- Minimum 3 lata
Who we are
Polcode is a Poland-based software house working with clients worldwide since 2006. We build web, mobile, and eCommerce products for startups and well-established companies across Europe, the US, and beyond.
The role
We’re currently looking for a Data Engineer with strong Databricks experience to join a long-term project in the energy sector. The cooperation is planned until the end of 2027, with an option to extend.
The project focuses on developing and continuously improving a modern data platform, with particular attention to data quality, scalable data processes, and providing reliable data for reporting.
Key responsibilities
- Design and develop scalable data solutions in Databricks
- Integrate data into an enterprise Data Lake using a Medallion Architecture
- Build and maintain data models supporting reporting
- Develop and orchestrate ETL/ELT processes and data pipelines
- Work with Python and SQL on data transformation and processing
- Support continuous data ingestion and development processes
- Contribute to permissions and access concepts
- Work within multi-tier deployment environments and Quality Gates
- Optimize data processes for better performance, efficiency, and quality
- Document architectural decisions, processes, and project outcomes
- Collaborate with stakeholders in an agile environment
Requirements
- Several years of commercial Data Engineering experience
- Hands-on commercial experience with Databricks
- Solid Python and SQL skills
- Experience with data modelling and ETL/ELT processes
- Experience building and orchestrating data pipelines
- Strong understanding of Data Lake / modern data platform concepts
- Understanding of layered data models such as Medallion Architecture (Bronze / Silver / Gold)
- Experience with permissions and access concepts
- Knowledge of continuous ingestion and continuous development practices
- Understanding of deployment processes and data quality practices
- Solution-oriented and structured approach to engineering challenges
- Strong communication skills and ability to work independently with stakeholders
- Experience working in agile projects, particularly Scrum
- Understanding of IT Service Management processes such as ITIL
- English allowing you to work effectively in an international environment
Nice to have
- Experience with Microsoft Azure in a Databricks / Data Engineering environment
- Experience with Spark or PySpark
- Experience with streaming, CDC, Auto Loader, Structured Streaming, or similar continuous ingestion approaches
- Experience with Machine Learning or LLM solutions in Databricks
- Experience with Jira and Confluence
- Good German language skills
Recruitment process
- People Interview – short call to talk about your experience and expectations
- Technical Interview – discussion focused on your experienced and skills
- Final Interview – final conversation with the client team
What we offer
- B2B: 110–150 PLN netto + VAT
- Multisport card, private medical care, life insurance, and meaningful gifts to celebrate important days
- All the necessary equipment for comfortable work
- Professional onboarding process
- We respect your private life - no overtime, no weekend jobs, work-life balance only, promise!
- Work at times that suit your daily rhythm, from the place of your choice
- Your work is appreciated - we believe in the power of feedback, as well as the one you give us.