Data Engineer Lead

Responsibilities

  • Design and develop complex data pipelines using advanced technologies (e.g Spark, HIVE, Python, Airflow and others)
  • Work with a variety of databases (Redshift, MySQL, BigQuery, MemSQL etc.)
  • Design and develop analytics products, data visualization, and data solutions for internal and external customers
  • Develop end-to-end solutions, while working in a fast-changing environment
  • Analyze and improve performance, scalability, and stability of our systems, environments, and tools

Requirements

  • 3+ years of experience in a similar role
  • Experience with OOP language such as Python (or similar)
  • Excellent hands-on SQL skills
  • Experience working in cloud environments (AWS, GCP, Azure)
  • Hands-on experience in building complex data pipeline technologies, such as Spark, Presto Airflow, etc.
  • Experience working in a Big Data environment
  • Eager to learn and explore new technologies
  • Strong analytical skills
  • Passionate and a “can-do” attitude and high communication skills

Advantages

  • Hands-on experience with developing and maintaining a complex production system
  • Experience working with Airflow
  • Experience working with AWS services: EC2, EMR, RDS, Redshift

Job Category: bi data
Job Type: Full Time
Job Location: Herzliya Remote

Apply for this position

Allowed Type(s): .pdf, .doc, .docx