Senior Data Engineer

We are seeking a talented and motivated Senior Data Engineer with expertise in Scala and Python to join our dynamic data engineering team.

The ideal candidate has a passion for building scalable and efficient data-driven solutions and is eager to broaden their knowledge base in the entire data engineering stack, including hardware infrastructure, frameworks, technologies, resource consumption, and project development

Key responsibilities:

• 
  
•  Collaborate with cross-functional teams, including data scientists, data analysts, and software engineers, to design, develop, and maintain data engineering solutions using Scala and Python.
• 
  
• 
  
•  Drive the exploration and implementation of new data engineering technologies, frameworks, and tools to enhance performance, scalability, and efficiency.
• 
  
• 
  
•  Work closely with infrastructure and operations teams to understand and optimize hardware and resource consumption in data engineering projects.
• 
  
• 
  
•  Develop a deep understanding of the underlying hardware infrastructure, including servers, clusters, and distributed systems, to ensure optimal data processing and storage.
• 
  
• 
  
•  Participate in the design and architecture of data pipelines, ensuring high performance, fault tolerance, and scalability.
• 
  
• 
  
•  Conduct research and stay up-to-date with the latest advancements in data engineering, hardware technologies, and distributed computing paradigms.
• 
  
• 
  
•  Mentor and guide junior team members, fostering a culture of continuous learning and skill development.
• 
  
• 
  
•  Collaborate with stakeholders to gather requirements, propose technical solutions, and deliver high-quality data engineering projects.
• 
  

Who you are!

• 
  
•  3+ years of professional experience as a Software Engineer, with a focus-on and passion towards data engineering.
• 
  
• 
  
•  Strong proficiency in Scala and Python, with hands-on experience in building robust and scalable applications
• 
  
• 
  
•  Solid understanding of data structures, algorithms, and object-oriented programming principles.
• 
  
• 
  
•  Experience with distributed data processing frameworks such as Apache Spark is highly desirable.
• 
  
• 
  
•  Familiarity with Apache Hive, Hadoop HDFS, and other relevant data engineering technologies is a plus.
• 
  
• 
  
• Strong interest in gaining knowledge of hardware infrastructure, resource consumption optimization, and project development in data engineering.
• 
  
• 
  
•  Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra) is beneficial.
• 
  
• 
  
•  Demonstrated ability to work in an Agile development environment and manage multiple priorities effectively.
• 
  
• 
  
•  Excellent problem-solving and analytical thinking skills.
• 
  
• 
  
•  Strong communication and collaboration skills, with the ability to work effectively in a team setting.
•