Full Job Description
JOB DESCRIPTION: Position is based in Charlotte, NC, some teleworking may be permitted. Travel to Lowe's offices may be required.
Translates business requirements and specifications into logical program designs, modules, stable application systems, and data solutions with occasional guidance from senior colleagues; partners with Product Team to understand business needs and functional specifications. Develops, configures, or modifies integrated business and/or enterprise application solutions within various computing environments by designing and coding component-based applications using various programming languages. Conducts the implementation and maintenance of complex business and enterprise data solutions to ensure successful deployment of released applications. Supports Systems Integration Testing (SIT) and User Acceptance Testing (UAT), provides insight into defining test plans, and ensures quality software deployment. Participates in the end-to-end product lifecycle by applying and sharing an in-depth understanding of company and industry methodologies, policies, standards, and controls. Understands Computer Science and/or Computer Engineering fundamentals; knows software architecture and readily applies this to Data or Platform solutions. Automates and simplifies team development, test, and operations processes; develops conceptual, logical and physical architectures consisting of one or more viewpoints (business, application, data, and infrastructure) required for business solution delivery. Solves difficult technical problems; solutions are testable, maintainable, and efficient. Supports the build, maintenance and enhancements of data lake development; supports simple to medium complexity API, unstructured data parsing and streaming data ingestion. Supports the build, maintenance and enhancements of BI solutions; creates standard and ad hoc reports; uses basic report formatting like sorting, totaling, and exporting.
JOB REQUIREMENTS: Job requires a Bachelor's degree* in Computer Science, CIS, Engineering, Data Science or a related field AND 2 years of experience in any job title/occupation involving software development or a related field, OR Master's Degree in Computer Science, CIS, Engineering, Data Science or a related field. Experience can be gained through any combination of work experience, coursework and/or other experience. *Employer will accept single degree or combination of degrees, diplomas and/or professional experience equivalent to a Bachelor's degree.
Must have prior experience in:
• Ability to design, implement, and optimize complex ETL processes to extract data from different sources, transform it into the desired format, and load it into target systems;
• Ability to design and implement automated workflows using orchestration tools like Airflow and oozie;
• Spark, HDFS, Hive, Shell Scripting, Jenkins, Git, and ETL scripts;
• Implement CI/CD pipelines for data engineering processes, including automated testing and deployment;
• Monitoring and logging tools to ensure the health and performance of data pipelines and applications;
• Distributed computing frameworks like Apache Spark and can design and implement data processing solutions that scale across a cluster of nodes;
• Azure Data Bricks, pyspark, and Azure sql; and
• Python, airflow, CI/CD data pipelines.
