Tech Lead, Data Engineering in Boston, MA

$100K - $150K(Ladders Estimates)

Cogito   •  

Boston, MA 02108

Industry: Enterprise Technology

  •  

5 - 7 years

Posted 55 days ago

Cogito is growing our Data Engineering team as we continue to improve how enterprise clients speak with their customers. We're seeking a technical lead who can design, develop and delivery large-scale data assets and workflows. You are interested in reporting platforms and data visualization and have experience working with large datasets.


You'll be the genius who understands data at Cogito, knows where to find it, and manages the process to make that data actionable for analytics. You love thinking about the ways the business can consume this data and then figuring out how to build data pipelines and data models provide them for business uses.


You'll own a problem end-to-end, so those skills will come in handy not just to collect, extract, clean and transform data, but also to understand the systems that generated it, and automate your analyses and reporting. You will help lead a high performing team that improves the data by adding new sources, coding business rules, and producing new metrics that support the business.

Responsibilities:

  • Design, develop, test and deliver industry-strength data pipelines to collect, organize, and standardize data for generating insights and addressing reporting needs including batch and real-time data flows
  • Manage the technical scope and architecture of the project before, during, and after delivery
  • Review and document the decisions the team makes to ensure consistency and alignment with the vision.
  • Mentor team members
  • Prioritize critical tasks and conflicting requirements with a high attention to detail
  • Collaborate with product management, peers and other stakeholders to ship quality products and help foster a great culture that is both high-performing and fun to be a part of

Requirements:

  • BS in Computer Science or a related field
  • 5+ year of relevant experience with 3+ years
  • Proficiency in at least one modern programming language such as Java, Scala, or Python
  • Knowledge of data management fundamentals and data storage principles
  • Experience working with AWS Big Data Technologies (EMR, Redshift, S3)
  • Strong SQL and NoSQL skills
  • Excellent written and verbal communication skills
  • Strong problem-solving skills and ability to prioritize conflicting requirements
  • Ability and willingness to learn new tools and technologies

Skills:

  • Experience with Serverless architecture or other Big Data architecture best practices
  • Experience with a streaming platform such as Kinesis, Kafka, Spark Streaming, Flink, etc.
  • Experience with solution building and architecting with public cloud offerings like AWS S3, Lambda functions, Presto/Athena or similar solutions, DynamoDB, Redshift, EMR/Spark
  • Experience with PostgreSQL and/or Aurora
  • Deep understanding of big data challenges and ecosystems
  • Working understanding of container technologies such as Docker
  • Familiarity with agile development methodologies
  • Experience with CI/CD pipelines, process and automation
  • Experience in test automation and ensuring data quality across multiple datasets used for analytical purposes
  • Comfortable working as both part of a high-performing, diverse team and as an independent performer
  • Ability to multitask and prioritize critical tasks and conflicting requirements with a high attention to detail

Benefits

• Your choice of comprehensive benefits for you and your family's health, dental, vision, disability, and life insurance

• Frequent catered lunch and live product demos

• 401(k) retirement plan options

• Ongoing professional development and cross-training

• 20 days vacation time, 5 days sick time, 2 floating holidays and 11 company holidays (yes, Patriot's Day is a holiday)

• 2 "Be Gentle" personal days

• Company paid parental leave upon hire

• Competitive pay, stock options, and annual bonus eligibility

• Casual dress and fun office atmosphere

• Pre-tax commuter benefits

• Stocked groceries in the kitchen

• Office location in the heart of Boston with convenience to the MBTA lines

Valid Through: 2019-10-21