Senior Data Engineer

Lixar I.T., Inc.

$100K — $130K *
Information Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • Post-secondary education in engineering or computer science, or equivalent experience
  • Proven experience with Apache Hadoop ecosystem including Spark, Hive, and HDFS
  • Proficient in SQL and NoSQL databases
  • 5+ years programming experience in Python
  • Experience with RESTful Web Services and JSON
  • Familiarity with cloud-based solutions (AWS/Azure)
  • Experience with production systems

Responsibilities

  • Support ongoing development of cutting-edge applications
  • Collaborate with team members to solve big data challenges
  • Design and implement data processing frameworks using Hadoop and cloud solutions
  • Develop data workflows and ETL processes
  • Ensure data quality and reliability in production systems
  • Document and communicate technical requirements and solutions

Benefits

  • Collaborative and innovative work environment
  • Opportunities for professional development and growth
  • Flexible work routine
  • Focus on team dynamics and communication
  • Support for learning new technologies
Full Job Description
As an experienced Data Engineer, you have:
  • Post-secondary education in engineering or computer science or equivalent work experience
  • A proven track record using the Apache Hadoop ecosystem (Spark, Data Lake, Hive, HDFS, Impala) to tackle "big data" problems
  • A master of all things SQL (and NoSQL)
  • 5+ years of programming experience in Python
  • Proven experience using RESTful Web Services & JSON
  • Good experience using Cloud based data solutions (AWS/Azure)
  • Experience working with production systems
  • Knowledge of ELT, ELT, Lambda and Kappa data architectures

Preferably, you also have:
  • Knowledge of Continuous Integration and Source Control systems (e.g. Gradle, Maven, Bamboo, TeamCity, Git)
  • Experience with DataBricks
  • Some Data Visualization experience in Power BI, Tableau, or similar
  • Exposure to data science, machine learning or statistics
  • Some experience using Docker

As the ideal candidate, you:
  • Have a sense of humour
  • Know that your routine is in fact, not routine
  • Communicate exceptionally well with management, peers, and clients
  • Have "Attention to detail" as your middle name
  • Don't blame others for your mistakes
  • Get things done!

Similar Jobs

More Jobs at Lixar I.T., Inc.

  • Senior Data Engineer
    $100K — $130K *
    Ottawa, ON K1G 3J6
    Information Technology
    In-Person

More Information Technology Jobs

Find similar Senior Data Engineer jobs: