Relocate to 🇵🇱 Poland

Responsibilities

• Architecture design and implementation within a team of experienced Data Engineers.
• Development of big data processing pipeline based on data streaming platform (NATS JetStream).
• Data modeling and processing in various databases (PostgreSQL, MongoDB, ElasticSearch).
• Performance optimization for both computation time and storage size.
• Data collection from well documented and not documented APIs (YouTube, Instagram, TikTok etc.).
• Development of internal web service written in Python.
• Setup data monitoring and anomalies detection.
• Experimentation with new tools, technologies and databases.

Requirements

• Hands-on experience with Python (at least 5 years)
• Experience in Big Data processing or Data Engineering (at least 1 year)
• Understanding of streaming platforms, such as Kafka, NATS JetStream etc.
• Expert in at least one DB engine (Relational, columnar or document-based)
• Strong troubleshooting and debugging skills
• Docker and cloud platform working experience
• Advanced communication skills, both verbal and written, being comfortable with change which arises through company growth

Nice to have

• Working experience with Google Cloud Platform / Kubernetes
• Experience in Machine Learning engineering, participation in ML project would be a plus
• Asynchronous Python programming skills
• Experience in working with domain-driven design methodology, working with data projects from scratch

Product technology stack

Data Collection & Pipelines: Python 3.10 (asyncio), NATS JetStream, ElasticSearch, Docker, Airflow, PostgreSQL, MongoDB, FastAPI, Google Cloud Platform, GitHub Actions

We believe in supporting our employees both at and away from work, and we really value a healthy work-life balance.

Our benefits package includes:

• Competitive salary;
• Flexible schedule;
• Office //Hybrid working setup for the most optimal work-life balance for you;
• 5 sick days without documents;
• Corporate English;
• Learning compensation (certifications, professional courses).