Southern Company

Data Engineer I or II

Southern Company • $80K — $110K *
Atlanta, GA 30349In-Person
Information Technology
Less than 5 years of experience
1 month ago
Job Overview by Ladders

Qualifications

  • Bachelor's degree in computer science, engineering, or related field preferred
  • 3-5 years of experience in data engineering
  • Experience with Microsoft analytics tools and Azure
  • Proficiency in SQL, Python, or Java
  • Expertise in relational and NoSQL databases

Responsibilities

  • Design and maintain data pipelines for data collection and processing
  • Integrate data from multiple sources into a unified format
  • Manage and optimize database performance and security
  • Ensure data quality and implement validation processes
  • Collaborate with data scientists to meet analytical needs

Benefits

  • Hybrid work model (4 days in office, 1 day remote)
  • Commitment to continuous learning and development
  • Opportunities to innovate and implement new technologies
  • Collaborative team environment
  • Focus on ethical conduct and safety
Full Job Description
Job Description

This position will be filled in the Data Analytics team within Technology Services. Data Engineer will be responsible for designing, developing, and maintaining our data infrastructure. This role involves working closely with data scientists, analysts, and other stakeholders to ensure that data pipelines are efficient, reliable, and scalable. The ideal candidate will have a strong background in data engineering, a passion for technology, and a commitment to delivering high-quality solutions.

Education/Experience:
  • Bachelor's degree in computer science/engineering or related degree preferred
  • Experience with implementing analytics solutions using the Microsoft analytics toolset and Microsoft Azure
  • Experience working in a fast-paced, competitive information technology organization
  • Exempt 05 requires minimum 3 years of experience
  • Exempt 06 requires minimum 5 years of experience


Knowledge/Skills:

1. Strong Programming Skills
  • Languages: Proficient in languages like SQL, Python, or Java. These are essential for building data pipelines, scripting automation, and manipulating data.
  • Efficiency: Writing efficient, scalable, and clean code to handle large datasets and optimize performance.

2. Deep Knowledge of Databases & Data Warehousing
  • SQL and NoSQL: Mastery in relational databases (like MS SQL Server, MySQL, PostgreSQL, Oracle) and NoSQL databases (like MongoDB, Cassandra, DynamoDB), knowing when and how to use each type.
  • Data Warehousing: Expertise in using platforms like MS SQL Server, Oracle, Amazon Redshift, Google BigQuery, Snowflake, or traditional data warehouses to store, query, and manage large volumes of data.
  • Database Optimization: Skills in optimizing queries, indexing, partitioning, and designing efficient database schemas for high performance.

3. Expertise in Data Pipeline Construction
  • ETL/ELT Processes: Proven ability to design and build robust ETL pipelines (Extract, Transform, Load) for collecting, cleaning, and moving data.
  • Real-time and Batch Processing: Experience working with both batch and real-time data processing frameworks (e.g., Apache Kafka, Apache Flink, Apache Spark, Databricks).
  • Data Orchestration: Familiarity with orchestration tools like Apache Airflow.
  • Strong knowledge of Medallion Architecture

4. Cloud Platform Expertise
  • Cloud Services: Proficiency in cloud platforms like Azure* (SQL Database, Data Lake, Lake House), AWS (S3, Lambda, Redshift), or Google Cloud (BigQuery, Dataflow). *Azure is preferred.
  • Scalability: Ability to design systems that scale efficiently in the cloud, handling big data and increasing demand without sacrificing performance.

5. Data Transformation and Cleaning Skills
  • Data Quality Management: Experience in data cleansing, validation, and transformation, ensuring that data is accurate, complete, and in the right format for analysis.
  • Data Integration: Expertise in integrating data from diverse sources (internal and external) while resolving issues like inconsistency or format mismatches.

6. Performance Optimization and Troubleshooting
  • Query Optimization: Ability to fine-tune queries, databases, and pipelines to reduce latency, optimize resource usage, and speed up data processing.
  • System Monitoring: Familiarity with monitoring systems and logging tools to detect, diagnose, and resolve performance or data issues.

7. Strong Analytical Skills
  • Data Interpretation: Ability to translate business requirements into technical solutions, ensuring the correct data is collected and processed for reporting, analytics, and decision-making.
  • Problem Solving: A strong ability to troubleshoot and resolve complex data challenges or inconsistencies that can affect the integrity and availability of data.

8. Knowledge of Big Data Tools
  • Big Data Frameworks: Familiarity with big data technologies such as Spark or Flink for processing large datasets across distributed systems.
  • Data Lakes and Data Pipelines: Experience with data lakes (e.g., Azure Lakehouse, AWS S3, HDFS) for storing raw and unstructured data and building pipelines to process it efficiently.

9. Collaboration and Communication Skills
  • Cross-functional Collaboration: Proven ability to work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver optimal solutions.
  • Clear Communication: Ability to explain technical concepts to non-technical stakeholders, ensuring that data infrastructure decisions align with business goals.

10. Data Security & Governance Awareness
  • Data Privacy: Knowledge of data privacy regulations (e.g., GDPR, CCPA) and ensuring that systems comply with these laws while managing sensitive data.
  • Access Control: Implementing strong data access controls, encryption, and monitoring to secure data both at rest and in transit.

11. Adaptability to New Tools and Technologies
  • Continuous Learning: A strong commitment to keeping up with the rapidly evolving tech landscape, experimenting with and implementing new tools, frameworks, and approaches to data engineering.
  • Flexibility: Adaptability to changing data architectures or business needs, ensuring data systems remain resilient and future-proof.


12. Automation & DevOps Skills
  • Automation Tools: Familiarity with CI/CD pipelines and automation tools (like Jenkins, Docker, Kubernetes) to streamline development and deployment of data engineering solutions.
  • Infrastructure as Code (IaC): Experience with tools like Terraform or Azure Resource Manager (ARM) to manage data infrastructure efficiently.


General Job Responsibilities:
  1. Data Pipeline Development:
    1. Designing, building, and maintaining robust data pipelines to collect, clean, and process data from various sources. Using Microsoft Analytics Tool stack on-prem and Azure Cloud. For example, SSIS, SSAS, SQL Server, Azure Lake House, MS Fabric, Databricks etc.
    2. Ensuring data is stored efficiently for easy access and retrieval (e.g., in data lakes, warehouses).
  2. Data Integration:
    1. Integrating data from multiple systems, applications, and external sources.
    2. Ensuring data is harmonized and available in a format suitable for analysis.
  3. Database Management:
    1. Creating and managing databases, ensuring that they are optimized for performance, security, and scalability.
    2. Handling structured and unstructured data.
  4. Data Quality Assurance:
    1. Monitoring and ensuring the accuracy, consistency, and reliability of data.
    2. Implementing processes for data validation, cleansing, and enrichment.
  5. Performance Optimization:
    1. Optimizing queries and databases for faster performance and lower latency.
    2. Tuning and troubleshooting database performance issues.
  6. Collaboration with Data Scientists & Analysts:
    1. Working closely with data scientists, analysts, and other stakeholders to understand data needs.
    2. Ensuring data is ready and available for analysis, machine learning models, and reporting.
  7. ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) Processes:
    1. Implementing ETL/ELT processes to extract data from different sources, transform it into usable formats, and load it into data warehouses or lakes.
    2. Understanding the different and when to apply each approach
  8. Automation and Monitoring:
    1. Automating repetitive tasks related to data processing and integration.
    2. Setting up monitoring to track data quality, pipeline performance, and system health.
  9. Data Security & Compliance:
    1. Ensuring data security measures are in place to protect sensitive information.
    2. Adhering to data privacy regulations and compliance standards, such as GDPR or CCPA.
  10. Tool and Technology Evaluation:
    1. Evaluating and implementing new tools, frameworks, and technologies to improve data infrastructure.
    2. Keeping up to date with the latest trends in big data and cloud technologies.


Core Behavioral Attributes:

Additional required behavioral attributes:
  • Results-oriented
  • Innovative
  • Strategic thinker with an enterprise view for sustainable solutions
  • Committed to continuous learning and improvement
  • Committed to the development of others
  • Committed to building and maintaining constructive partnerships with business partners
  • Works well both independently and with others
  • Acts with speed and decisiveness
  • Committed to ethical conduct
  • Lives and works safely

Note: The position is Hybrid, Atlanta, GA or Birmingham, AL. Four days in the office; and one day remote a week.

About the Team

Southern Company Services

About Southern Company

With 4.4 million customers and more than 42,000 megawatts of generating capacity, Atlanta-based Southern Company is the premier energy company serving the Southeast. A leading U.S. producer of electricity, Southern Company owns electric utilities in four states and a growing competitive generation company, as well as fiber optics and wireless communications. Southern Company brands are known for excellent customer service, high reliability and retail electric prices that are significantly below the national average. Southern Company has been listed the top ranking U.S. electric service provider in customer satisfaction for nine consecutive years by the American Customer Satisfaction Index.

Southern Company Careers

Join the dynamic team at Southern Company, a leader in energy innovation and a champion of sustainable practices. As one of the most respected companies in the energy sector, Southern Company offers unparalleled job opportunities that promise not only professional growth but also a commitment to diversity and leadership development.

Work You’ll Do

At Southern Company, we are not just about power generation; we are about empowering our team to innovate and lead the industry. By joining our team, you will collaborate with some of the brightest minds in the field, using your skills to solve complex problems and drive meaningful change.

Explore a World of Opportunities

Whether you are looking for a full-time position, an internship, or a leadership role, Southern Company has a place for you. Our wide range of employment options ensures that every team member can find a path that best suits their career ambitions and skills.

Innovate and Lead

Southern Company is at the forefront of technological innovation in the energy sector. Our team members are encouraged to lead projects and initiatives that push the boundaries of what is possible in energy production and management.

Grow and Develop

We believe in nurturing the potential of our employees through targeted diversity training, leadership workshops, and continuous professional development. Career growth at Southern Company is not just a possibility—it is an expectation.

Be Part of Our Culture

Southern Company’s culture is built on a foundation of respect, integrity, and inclusion. We celebrate diversity and believe that it drives innovation. Our team is our family, and we support each other in achieving personal and professional goals.

Benefits That Go Beyond

Choosing a career at Southern Company means enjoying a range of benefits designed to enrich your life and support your lifestyle. From health and wellness programs to retirement plans, we ensure our team members are taken care of.

Join Our Team

Ready to power up your career? Explore the job opportunities at Southern Company today. We are actively hiring and looking for passionate, curious, and solution-driven individuals. Enhance your skills, join a community of innovators, and work towards a sustainable future.

Stay Connected

Keep up to date with the latest at Southern Company by following our careers blog. Gain insider perspectives, industry-leading insights, and practical tips to advance your career.

Networking and Career Advancement

At Southern Company, networking and internal mobility are key components of career advancement. Connect with leaders, engage in cross-departmental projects, and take your professional journey to new heights.

Prepare for Your Interview

Make your mark from the first interview. Visit our career site for tips on crafting your resume, preparing for interviews, and making a lasting impression.

Join Southern Company—where careers glow brighter!

SEARCH SOUTHERN COMPANY JOBS Stay ahead of the curve in your career with Southern Company, where innovation meets tradition and every employee is empowered to excel.
Learn more about Southern Company
Size
27,000 employees
Market Cap
$77.6 billion
Industry
Energy & Utilities
Net Income
$3.1 billion
Founded
1912
5 Year Trend
+3%
Revenue
$20.3 billion
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Southern Company

More Information Technology Jobs

Find similar Data Engineer I or II jobs:

NationwideAtlanta, GA