Lead Data Engineer
Big-league professionals never stop and always seek ways to enhance their expertise. The position of Lead Data Engineer on the NIX team is suitable for such experts. With us, the expert will be able to take their career to the next level and fully unleash their potential!
We are looking for a contractor who, if necessary, is ready to independently relocate to Hungary, Budapest.
RESPONSIBILITIES:
- Lead the design and development of data engineering solutions, including data pipelines and ETL processes, leveraging your technical expertise.
- Lead and mentor a team of data engineers, providing technical guidance and oversight to ensure high-quality deliverables.
- Accurately estimate time and resources required for new projects.
- Promote a continuous learning and improvement culture, staying up-to-date with industry best practices and emerging technologies.
- Evaluating team performance and providing feedback and coaching.
- Encouraging collaboration and open communication within the team and with other stakeholders.
- Participating in the recruitment process to select new team members.
WHAT WE EXPECT FROM YOU:
- Strong technical skills in code review, architecture and data models.
- Experience with designing data pipelines and building ETL processes.
- Passion for continuous learning and improvement.
- Ability to accurately estimate time and resources for projects.
- Ability to manage timelines and deadlines while ensuring high-quality work.
- Excellent communication and collaboration skills.
- Ability to identify and address performance issues and recognize high performers.
- Strong leadership and mentoring skills.
- Experience in recruiting and building a team.
REQUIRED SKILLS:
- Minimum English level B2.
- 6+ years of proven experience developing software using an object-oriented or functional language.
- Strong programming skills in Python or Scala/Java.
- Proficiency in SQL and query tuning.
- Solid with distributed computing approaches, patterns, and technologies (Spark/PySpark).
- Deep knowledge of data warehousing principles and modeling concepts (knowledge of data model types and terminology including OLTP/OLAP, (de)normalization, dimensional, star).
- Experience working with Cloud Platforms (GCP, AWS, Azure – any of the listed) and their data-oriented components.
- Experience in modern data warehouse building using modern tools (e.g., Snowflake, AWS Redshift, BigQuery).
- Expertise in the use of any relational databases (e.g., PostgreSQL, MSSQL, MySQL).
- Experience with any tool for orchestration of data flows (e.g., Apache Airflow, Talend, Glue, Azure Data Factory).
- A team player with excellent collaboration skills.
WILL BE A PLUS:
- Expertise in data storage design principles. Understanding of pros and cons of SQL/NoSQL solutions, their types and configurations (standalone/cluster, column/row-oriented, key-value/document stores).
- Deep knowledge of Spark internals (tuning, query optimization).
- Experience with data integration and business intelligence architecture.
- Experience with non-relational databases (e.g., MongoDB, DynamoDB).
- Experience with data lakes, data lake houses (Azure Data Lake, Apache Hudi, Apache Iceberg, Delta Lake).
- Experience with stream processing using the current industry standards (e.g., AWS Kinesis, Kafka streams, etc.).
- Distributed computing systems such as Hadoop, Storm, Hive, and Beam;
- Experience with containerized (Docker, ECS, Kubernetes) or serverless (Lambda) deployment.
- Good knowledge of popular data standards and formats (e.g., JSON, XML, Proto, Parquet, Avro, ORC, etc.).
- Experience with Informatica, Databricks, Talend, Fivetran or similar.
- Experience in data science and machine learning with building Machine Learning models.
WHAT WE OFFER:
- Competitive compensation packages.
- Stable employment, based on a full-time employment contract.
- Private health insurance (Medicover).
- AYCM sport pass, providing discounts at various sports facilities in Hungary.
- Interesting tasks and diverse opportunities for developing your skills.
- Free training courses.
- Participation in internal and external thematic events, technical conferences.
- All necessary devices and tools for your work.
- Active corporate life.
- The friendly and supportive atmosphere within the team.
If you’re ready to challenge yourself in a promising industry, please send your resume to jobs@nixsolutions.com. We’ll be glad to help you become an IT professional!