Big Data Architect

Magellan Health Services   •  

Glen Allen, VA

15+ years

Posted 304 days ago

This job is no longer available.

This Big Data Architect position is a Remote Opportunity for the right candidate. The candidate will lead the data lake and data integration architecture for the Magellan data lake (on-prem and Cloud) and be responsible for leading the development of reusable design patterns that accelerate analytic and innovation efforts in the analytic environments.

Position Responsibilities

Design and implement scalable Big Data architecture solutions

Architect, design and implement high performance large volume data integration processes, data provisioning and advanced analytical capabilities.

Provide guidance and platform selection advice for common Big Data (Distributed) platforms

Design data flow and processing pipelines for ingestion and analysis using modern toolsets such as Spark on Scala, Kafka, Flume, Sqoop, and others.

Partner with Data Governance Leader and other Data Architects on designs supporting Enterprise Data Governance.

Develop and recommend novel and innovative - yet proven and demonstrated - approaches to solving business and technical problem using advanced analytics solutions.

Design data provisioning structures for ingestion and reporting, specific to use case and technology.

Provide data management expertise in evaluating requirements and developing data architecture and refining platform components and design

Mentor and guide junior data engineers, DevOps engineers, share best practices, and perform code reviews

Collaborate with cross-functional teams to utilize the new big data tools

Actively engage and lead the Modern Data  community at Magellan driving new data capability forward

Qualifications and Requirements:

BA/BS degree or equivalent experience; Computer Science or Math background preferred

Over 15 years of engineering and/or software development experience and demonstrable architecture experience in a large organization.

Hands-on experience in Big Data Components/Frameworks such as Hadoop, Spark, Storm, HBase, HDFS, Pig, Hive, Scala, Kafka, PyScripts, Unix Shell scripts

Experience in architecture and implementation of large and highly complex big data projects

Experience of Hadoop and related technologies (Cloudera, Hortonworks, etc.)

Experience with data integration and streaming tools used for Hadoop (Spark, Kafka, etc.)

Experience in Metadata management, data lineage, data governance, especially as related to Big Data

Experience with cloud platforms (AWS/Azure), including readiness, provisioning, security, and governance

Experience or understanding of Data Science and related technologies (Python, R, SAS, etc.)

Experience or understanding of Artificial Intelligence (AI), Machine Learning (ML), and Applied Statistics

History of working successfully with cross-functional engineering teams

This position is the Architecture leader for the Supply Chain of Data program and is a visible leader both internal and external to Magellan. Must be an expert in architecture methods and technologies across multiple data platforms. Shown ability to shape and drive strategic vision. Excel at inspiring, motiving and creating highly productive teams. Expert at attracting, hiring and developing a strong bench of talent. Possesses a unique combination of highly evolved technical skills as well as the ability to envision a strategy and be creative in order to realize ambitious goals on behalf of the business. Inspire the organization to create world-class solutions. Must be passionate about supporting the business and company vision. Ability to communicate a clear point of view from a business perspective in strategic discussions with executive leadership.

Essential Functions:
- Influence changes and system enhancements to business processes, policies, and infrastructure to deliver the most effective IT services.
- Manage the selection, evaluation, contracting and integration of externally available hardware, software, and processes to deliver business solutions.
- Direct and manage, through analysis, the planning, design, development, testing, installation and maintenance of support systems for both internal/external clients.
- Select and build strong teams through formal training, diverse assignments, coaching, mentoring, and other team development techniques, along with regular individual and group meetings.
- Develop tactical and strategic plans to satisfy technical business needs and new business proposals.
- Manage and develop project cost estimates, benefits, justification and assessment of potential project risks.
- Manage projects, staff, customer expectations and business priorities to achieve customer and business unit satisfaction.
- Manage, plan and track all budgets and expenses.
- Oversee vendor relationships and projects.
- Direct and manage business process re-engineering associated with existing, developing and implementation of systems.
- Develops and maintains strong, cooperative relationships with other IT services groups. Shares and establishes best practices experiences and opportunities throughout the organization.
-ApplyAgile development practices in delivery of transformational programs asrequired.

Minimum Qualifications


Bachelors: Computer and Information Science (Required)

License and Certifications - Required

TOGAF - The Open GroupArchitectureFramework - Enterprise

License and Certifications - Preferred

Other Job Requirements


12+ years of experience in Software Engineering with 4+ years leading and managing teams. 2+ years of experience leading project/teams.
Experience managing and leading cross functional teams, workgroups.
Can including HR process and budget management.
Broader experience across IT or across different industries is a must.
Critical Thinker.
Demonstrated problem solving techniques.
Strong verbal and written communication skills.
Demonstrated ability to coach and build skills within the team., Experience in health care or insurance industries.