Pyspark Architect

Infosys Limited Digital$96K — $124K *
Plano, TX 75025In-Person
Enterprise Technology
5 - 7 years of experience
Job Overview by Ladders

Qualifications

  • 5+ years of experience in technology consulting and solutions architecture.
  • Proven proficiency with the Cloudera Hadoop ecosystem including tools like Hive, SPARK, and Kafka.
  • Deep understanding of Hadoop architecture and workload management.
  • Experience in designing ETL/ELT frameworks for complex data environments.
  • Strong software engineering background with expertise in data processing and REST APIs.

Responsibilities

  • Engage with customers to gather and analyze system requirements related to performance and scalability.
  • Propose solutions architecture and support enterprise architecture definition.
  • Identify and compare technologies to recommend optimal solutions for client needs.
  • Develop integration strategies based on proof of concept validations.
  • Ensure smooth project transitions through effective knowledge transfer.
  • Work closely with development teams to solve technical deployment issues.
  • Create technical artifacts that contribute to the team’s knowledge base.

Benefits

  • Medical, Dental, Vision, and Life Insurance coverage.
  • Short-term and long-term disability insurance.
  • Health and Dependent Care reimbursement accounts.
  • Comprehensive insurance options, including accident and legal.
  • 401(k) plan with company contributions based on salary level.
  • Generous paid time off, including holidays and PTO.
Full Job Description
Job Description

In the assigned Job Role of Architecture Consultant 2, your Area Of Responsibility will be as below:
• Participate in customer discussions to gather and analyze system requirements for performance, security and scalability.
• Provide suggestions on solution architecture, contribute to tech framework development, support enterprise architecture definition, and drive design creation
• Identify suitable technologies and tools available in the market, and perform a comparative analysis in line with client's business requirement, thereby identifying optimal architectural solution options
• Participate in developing integration strategies based on validation of proof of concept of proposed architectural solutions
• Facilitate a smooth transition by ensuring knowledge transfer and adherence to quality standards, while contributing to the build and deployment automation strategy
• Collaborate with development teams to resolve complex technical issues using solution deployment and roll out methods, during build, deployment and support phases
• Analyze system performance basis architectural solutions implemented and support in identifying potential risks in the system landscape
• Create artifacts of architectural frameworks and technical solutions, thereby enriching team's knowledge repository

Your contribution to the team:
• The ability to analyse, design, and develop scalable and secure architectures.
• A knack for assessing multiple technologies, tools and frameworks to recommend optimal solutions.
• Understanding of integration methodologies, proof-of-concept validation and deployment strategies.
• The ability to document architectural frameworks and solutions.
• Proactive communication with internal teams and clients, ensuring alignment with business objectives.
• A knack to keep with up technical advancements to ensure relevant and effective recommendations.
• The ability to maintain standards and ensure smooth transition through knowledge transfer

Benefits

Along with competitive pay, as a full-time Infosys employee you are also eligible for the following benefits:
  • Medical/Dental/Vision/Life Insurance
  • Long-term/Short-term Disability
  • Health and Dependent Care Reimbursement Accounts
  • Insurance (Accident, Critical Illness , Hospital Indemnity, Legal)
  • 401(k) plan and contributions dependent on salary level
  • Paid holidays plus Paid Time Off

Required Skill and Experience
• Experience in technology consulting, enterprise and solutions architecture and architectural frameworks
• Experience in Cloudera Hadoop ecosystem, i.e. Hadoop, Hive, Scala, SPARK, Sqoop, Flume, Kafka, Python, NoSQL database technologies
• Understanding and knowledge of Hadoop architecture and various components such as high availability architecture, experience in workload management, scalability and distributed platform architecture
• Experience with design and implementation of ETL/ELT framework for complex warehouses/marts. Knowledge of large data sets and experience with performance tuning and troubleshooting
• Background in all aspects of software engineering with strong skills in parallel data processing, data flows, REST APIs, JSON, XML, and micro service architecture

Preferred Skill and Experience
• Experience in working in any hyperscalers, AWS, Azure, GCP, Databricks and Snowflake
• Experience in data virtualization/data federation for creating data product (e.g. in Starburst) in heterogenous environment (Hadoop, RDBMS, NoSQL etc.)
• Hands-on development mentality, with a willingness to troubleshoot and solve complex problems

Additional Required Qualifications
• Bachelor's degree or foreign equivalent required from an accredited institution. Will also consider three years of progressive experience in the specialty in lieu of every year of education.
• This position may require relocation and/or travel to work/project location.
• Candidates authorized to work for any employer in the United States without employer-based visa sponsorship are welcome to apply. Infosys is unable to provide immigration sponsorship for this role now or in the future.

Overview

The Infosys Financial Services unit is a global leader in driving digital transformation for financial institutions. We specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock business value. Our AI-driven solutions empower financial institutions to make smarter decisions, enhance customer experiences, and achieve operational excellence. Join us to be part of a pioneering team that is at the forefront of financial services transformation. You'll have the opportunity to work with cutting-edge AI technologies, collaborate with industry experts, and contribute to transformative projects across banking, wealth management, and insurance sectors. If you're passionate about AI and eager to make a significant impact, the Infosys Financial Services unit is the perfect place for you to grow and excel.

Additional Details

Estimated annual compensation range for candidate based in the below locations will be

Jersey City, NJ: $96,021 to 124,827

About Infosys Limited Digital

Infosys Limited Digital Careers

Joining Infosys Limited Digital offers a unique opportunity to be part of a global team of professionals who are at the forefront of digital innovation and transformation. Infosys Limited Digital is renowned for its commitment to leadership in technology services and consulting, making it an ideal place for ambitious individuals seeking growth and career advancement.

Explore Job Opportunities

Infosys Limited Digital is actively seeking talented individuals to join their team. With a variety of job opportunities available, candidates can find positions that match their skills and interests. The company values diversity and inclusivity, ensuring that all team members have the opportunity to contribute to their fullest potential.

Experience Professional Growth

At Infosys Limited Digital, professional growth is a priority. The company offers comprehensive benefits and diversity training programs that support both personal and professional development. Employees are encouraged to take leadership roles within projects, fostering a culture of innovation and continuous improvement.

Engage in Meaningful Work

Employees at Infosys Limited Digital engage in projects that transform businesses and industries worldwide. By leveraging cutting-edge technology and deep industry expertise, the team delivers solutions that meet the complex demands of today's digital landscape.

Internship Programs

For those starting their careers, Infosys Limited Digital’s internship programs provide a robust platform for learning and development. Interns gain hands-on experience, working alongside seasoned professionals on real-world projects. This not only enhances their skills but also prepares them for future employment opportunities within the company.

Join a Collaborative Team

Infosys Limited Digital prides itself on its collaborative culture. Team members from around the globe come together to share ideas and strategies, ensuring the best outcomes for clients and stakeholders. Networking within the company is highly encouraged, opening doors to myriad opportunities for career advancement.

Prepare for Your Interview

When applying for a position at Infosys Limited Digital, it is crucial to tailor your resume to highlight relevant experience and skills. Preparation for the interview process is key, as it is a chance to demonstrate how your background aligns with the company’s needs and values.

Stay Connected with Career Insights

Keep up to date with the latest in career opportunities and industry trends by subscribing to Infosys Limited Digital’s career blog. Gain insights from insiders and stay informed about new openings and company news.

Apply Now

Discover the exciting and rewarding career opportunities at Infosys Limited Digital. Search for open positions that align with your professional skills and interests. Infosys Limited Digital is looking for passionate, curious, and innovative team players ready to make a significant impact in the digital world.

SEARCH INFOSYS LIMITED DIGITAL JOBS

READ CAREERS BLOG

Job Alert Emails

Customize your subscription to receive job alerts and insider tips tailored to your preferences. Explore the diverse and dynamic career paths available at Infosys Limited Digital.
Learn more about Infosys Limited Digital

Similar Jobs

More Jobs at Infosys Limited Digital

More Enterprise Technology Jobs

Find similar Pyspark Architect jobs: