The Role

At the company, bold ideas become real impact. The Sr. Software Engineer will take ownership of modernizing critical data platforms using PySpark and Databricks. Operating in a high-trust, agile environment, this individual will help accelerate AI enablement, automation, and business innovation, demonstrating how empowered technical leaders can shape the future of AI-ready connectivity.

Location

This is a work from home position within the US.

The Main Responsibilities

• Partner in an Agile Scrum team environment to solution engineer, design, develop, code, test, debug, and support production-quality enterprise-grade systems.
• Support cloud migration and data modernization initiatives, including migration of data warehouse capabilities to PySpark and Databricks.
• Develop scalable, high-performance solutions that support large data volume processing and meet agreed SLAs for reliability, scalability, and performance.
• Work closely with business partners and technical staff to create solutions that meet business, technical, compliance, and governance requirements.
• Support AI enablement and automation initiatives, including work involving Databricks AI Genie where applicable.
• Build and maintain data engineering solutions using Databricks, PySpark, Python, SQL, Azure Data Factory, Java, Confluent Kafka, and Bash scripting.
• Collaborate with product developers and other engineering team members to define and implement effective automated testing and quality practices.
• Document work clearly to promote transparency, supportability, and reuse.
• Actively participate in code reviews and contribute to engineering best practices.
• Prioritize and manage multiple concurrent projects, operational support needs, and delivery commitments.
• Support regulated or critical infrastructure environments where compliance, security, and continuity of operations are required.

What We Look For in a Candidate

• 6 years of experience with a bachelor's degree (or equivalent) in Computer Science or a related field, or 4 years with a master's degree. Strong experience with Databricks, PySpark, Apache Spark, Python, SQL, Azure Data Factory, ETL concepts, and distributed data processing. Proficiency in PostgreSQL (queries, migrations, performance tuning), Java, Spring Boot, REST APIs, and building AI-ready data pipelines with metadata governance and analytics enablement.
• Experience with Kafka/event-driven architectures (Kafka Connect, JDBC connectors), Azure cloud technologies including AKS (Kubernetes), cloud networking, SSL/certificates, and deployments. Knowledge of CI/CD, GitHub, DevOps practices, Jira-based Agile delivery, software development methodologies, coding standards, and engineering best practices. Experience creating reconciliation, monitoring, and audit frameworks, as well as scalable, high-performance systems handling large data volumes.
• Strong collaboration, communication, documentation, problem-solving, and time-management skills. Experience with Bash/Unix/Linux scripting; Informatica, Oracle RDBMS/PL/SQL, compliance-sensitive systems, and telecommunications industry experience are preferred. Highly motivated, organized, reliable, detail-oriented, and quick to learn new technologies.
• Required Technical Skills: Databricks (including PySpark and AI Genie), Python, SQL, Azure Data Factory, Java, Confluent Kafka, Bash/Unix/Linux scripting, and Oracle RDBMS/PL/SQL (preferred).

Compensation

This information reflects the anticipated base salary range for this position based on current national data. Minimums and maximums may vary based on location. Individual pay is based on skills, experience and other relevant factors.

Location Based Pay Ranges

$84,629 - $112,838 in these states: AL AR AZ FL GA IA ID IN KS KY LA ME MO MS MT ND NE NM OH OK PA SC SD TN UT VT WI WV WY
$88,860 - $118,480 in these states: CO HI MI MN NC NH NV OR RI
$93,092 - $124,122 in these states: AK CA CT DC DE IL MA MD NJ NY TX VA WA

Lumen offers a comprehensive package featuring a broad range of Health, Life, Voluntary Lifestyle benefits and other perks that enhance your physical, mental, emotional and financial wellbeing. We're able to answer any additional questions you may have about our bonus structure (short-term incentives, long-term incentives and/or sales compensation) as you move through the selection process. Learn more about Lumen's:Benefits
Bonus Structure

#LI-Remote

Requisition #: 342747