Big Data Developer (Black Lotus Labs)

Lumen

$132K — $193K *
US-AnywhereRemote in United States
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Master's or Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent work experience.
  • Experience in developing data ingestion and processing pipelines with big data technologies (e.g., Spark, Kafka, Hadoop).
  • Proficient in programming languages like Python, Java, Scala, or SQL.
  • Knowledge of DevOps practices and tools.
  • Strong analytical, problem-solving, and detail-oriented skills.
  • Effective communication, leadership, and teamwork abilities.
  • Willingness to learn new technologies and take on challenges.

Responsibilities

  • Lead the design and implementation of big data solutions to combat online threats.
  • Build and architect scalable data pipelines using technologies such as Spark and Kafka.
  • Collaborate with cross-functional teams to meet data requirements and business objectives.
  • Transform and load data from various sources including databases and APIs.
  • Ensure data quality, integrity, and security throughout data processes.
  • Develop systems for real-time validation of resources.
  • Mentor junior developers to promote continuous learning and improvement.
  • Conduct evaluations and proofs of concept for new tech solutions to enhance threat detection.

Benefits

  • Comprehensive health and life insurance coverage.
  • Voluntary lifestyle benefits for wellbeing.
  • Flexible remote work arrangements.
  • Opportunities for professional growth and development.
Full Job Description
The Role

We are seeking a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. In this role, you'll leverage cutting-edge technologies, work alongside talented engineers and security professionals, and play a key role in protecting critical digital infrastructure.

As part of a collaborative, mission-driven team, you'll have the opportunity to lead innovative projects, influence technical direction, and grow your expertise while solving complex cybersecurity challenges at scale.

Location

This is a remote position open to candidates based anywhere in the US.

The Main Responsibilities

  • Lead the design, development, and implementation of big data solutions that allow the organization to identify and disrupt malicious threats on the Internet.
  • Architect and build scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
  • Collaborate with cross functional teams to understand data requirements and provide solutions to achieve business objectives
  • Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
  • Ensure data quality, integrity, and security across all data processes
  • Develop scalable systems that enable real-time validation of identified resources
  • Mentor and guide junior developers fostering a culture of continuous learning and improvement
  • Explore, evaluate, and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current data processing pipelines


What We Look For in a Candidate

  • Master's or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
  • Prior experience in developing data ingestion, data processing and analytical pipelines with big datatechnologies, such as Spark, Kafka, Hadoop, Hive, etc.
  • Proficient in programming languages, such as Python, Java, Scala, or SQL
  • Experience with DevOps practices and tools
  • Strong analytical and problem-solving skills, and attention to detail
  • Strong communication, leadership, and teamwork skills
  • Eager to learn new skills and technologies, and willing to take on challenges


Compensation

This information reflects the anticipated base salary range for this position based on current national data. Minimums and maximums may vary based on location. Individual pay is based on skills, experience and other relevant factors.

Location Based Pay Ranges

$132,232 - $176,310 in these states: AL AR AZ FL GA IA ID IN KS KY LA ME MO MS MT ND NE NM OH OK PA SC SD TN UT VT WI WV WY
$138,844 - $185,124 in these states: CO HI MI MN NC NH NV OR RI
$145,456 - $193,940 in these states: AK CA CT DC DE IL MA MD NJ NY TX VA WA

Lumen offers a comprehensive package featuring a broad range of Health, Life, Voluntary Lifestyle benefits and other perks that enhance your physical, mental, emotional and financial wellbeing. We're able to answer any additional questions you may have about our bonus structure (short-term incentives, long-term incentives and/or sales compensation) as you move through the selection process. Learn more about Lumen's:Benefits
Bonus Structure

#LI-Remote

Requisition #: 343323

Similar Jobs

More Jobs at Lumen

More Information Technology Jobs

Find similar Big Data Developer (Black Lotus Labs) jobs: