BlackRock, Inc

Data Engineer, Associate

BlackRock, Inc • $132K — $162K *
New York, NY 10025In-Person
Information Technology
Less than 5 years of experience
Reposted Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • 4+ years of hands-on experience in computer/software engineering with focus on big data engineering
  • Strong programming skills in Python or Scala with experience in UDFs and modules like pytest
  • Experience in building and optimizing big data pipelines and utilizing workflow management tools
  • Hands-on experience developing on Spark in a production environment
  • Proficiency with data management in Hive (on Spark) and various file formats
  • Experience using SQL and No-SQL databases, as well as GraphQL
  • Strong experience implementing solutions on Snowflake, including data governance and validation frameworks

Responsibilities

  • Lead the creation and maintenance of optimized data pipeline architectures for complex datasets
  • Assemble large, intricate datasets that fulfill business requirements
  • Collaborate with stakeholders on data-related technical issues and infrastructure needs
  • Automate processes for data ingest and optimize delivery under service level agreements
  • Ensure data segregation according to relevant policies
  • Collaborate effectively in a global team environment and take ownership of critical data components
  • Stay current on big data technology trends and recommend advancements
  • Investigate data discrepancies, identify root causes, and collaborate with teams to prevent recurrence

Benefits

  • Strong retirement plan
  • Tuition reimbursement
  • Comprehensive healthcare coverage
  • Support for working parents
  • Flexible Time Off (FTO) program
Full Job Description
About this role

  • Improve BlackRock's ability to enhance our retail sales distribution capabilities and services suite by creating, expanding and optimizing our data and data pipeline architecture.
  • You will create and operationalize data pipelines to enable squads to deliver high quality data-driven product.
  • You will be accountable for managing high-quality datasets exposed for internal and external consumption by downstream users and applications.
  • Top technical / programming skills - Python, Java and Scala with ability to work across big data frameworks such as Spark, Hadoop Suite, PySpark, Hive, Cloud Data Platforms Preferably Snowflake and SQL. Experience working with flat files (e.g., csv, tsv, Excel), Database API sources is a must to both ingest and create transformations.
  • Given the highly execution-focused nature of the work, the ideal candidate will roll up their sleeves to ensure that their projects meet deadlines and will always look for ways to optimize processes in future cycles.
  • The successful candidate will be highly motivated to create, optimize, or redesign data pipelines to support our next generation of products and data initiatives.
  • You will be a builder and an owner of your work product.

Responsibilities:
  • Lead in the creation and maintenance of optimized data pipeline architectures on large and complex data sets.
  • Assemble large, complex data sets that meet business requirements.
  • Act as lead to identify, design, and implement internal process improvements and relay to relevant technology organization.
  • Work with stakeholders to assist in data-related technical issues and support their data infrastructure needs.
  • Automate manual ingest processes and optimize data delivery subject to service level agreements; work with infrastructure on re-design for greater scalability.
  • Keep data separated and segregated according to relevant data policies.
  • Demonstrated ability to join a complex global team, collaborate crossfunctionally (data scientists, platform engineers, business stakeholders), and take ownership of major components of the data platform ecosystem and develop data ready tools to support their job.
  • Be up-to-date with the latest tech trends in the big-data space and recommend them as needed.
  • Identify, investigate, and resolve data discrepancies by finding the root cause of issues; work with partners across various cross-functional teams to prevent future occurrences.

Qualifications:
  • Overall 4+ years of hands-on experience in computer/software engineering with majority in big data engineering.
  • 4+ years of strong Python or Scala programming skills (Core Python and PySpark) including hands-on experience creating and supporting UDFs and modules like pytest.
  • 4+ years of experience with building and optimizing 'big data' pipelines, architectures, and data sets. Familiarity with data pipeline and workflow management tools (e.g., Airflow, DBT, Kafka).
  • 4+ years of hands-on experience on developing on Spark in a production environment. Expertise on parallel execution, deciding resources and different modes of executing jobs is required.
  • 4+ years of experience using Hive (on Spark), Yarn (logs, DAG flow diagrams), Sqoop. Proficiency bucketing, partitioning, tuning and handling different file formats (ORC, PARQUET & AVRO).
  • 4+ years of experience using Transact SQL (e.g., MS SQ Server, MySQL), No-SQL and GraphQL.
  • Strong experience implementing solutions on Snowflake
  • Experience with data quality and validation frameworks, especially Great Expectations for automated testing.
  • Strong understanding and use of Swagger/OpenAPI for designing, documenting, and testing RESTful APIs.
  • Experience in deployment, maintenance, and administration tasks related to Cloud (AWS, Azure Preferred), OpenStack, Docker, Kafka and Kubernetes. Familiarity with CI/CD pipelines for data pipeline automation and deployment (Jenkins, GitLab CI, Azure DevOps)
  • Experience with data governance, metadata management, and data lineageusing tools likeAxonandUnity CatalogExpertise in managing business glossaries, data access control, auditing, and ensuring centralized governance across data assets in both cloud and hybrid environments.
  • Hands-on experience with Databricks, including notebooks, workflows, and ML integrations.
  • Experience with working with global teams across different time zones
  • Plus - Experience with Machine Learning and Artificial Intelligence
  • Plus - Experience with Generative Artificial Intelligence
For New York, NY Only the salary range for this position is USD$132,500.00 - USD$162,000.00 . Additionally, employees are eligible for an annual discretionary bonus, and benefits including healthcare, leave benefits, and retirement benefits. BlackRock operates a pay-for-performance compensation philosophy and your total compensation may vary based on role, location, and firm, department and individual performance.

Our benefits

To help you stay energized, engaged and inspired, we offer a wide range of benefits including a strong retirement plan, tuition reimbursement, comprehensive healthcare, support for working parents and Flexible Time Off (FTO) so you can relax, recharge and be there for the people you care about.

Our hybrid work model

BlackRock's hybrid work model is designed to enable a culture of collaboration and apprenticeship that enriches the experience of our employees, while supporting flexibility for all. Employees are currently required to work at least 4 days in the office per week, with the flexibility to work from home 1 day a week. Some business groups may require more time in the office due to their roles and responsibilities. We remain focused on increasing the impactful moments that arise when we work together in person - aligned with our commitment to performance and innovation. As a new joiner, you can count on this hybrid model to accelerate your learning and onboarding experience here at BlackRock.

About BlackRock, Inc

BlackRock is an investment management company that provides its services to a diverse range of clients, including institutions, intermediaries, foundations, and individual investors. The firm operates as a global asset manager, overseeing and advising on a wide array of investment portfolios. In addition to its role as an investment manager, BlackRock is also known for its technological innovations and solutions that support various aspects of the financial industry. The company's multifaceted approach encompasses investment management, financial technology, and serving a broad spectrum of clients in the financial ecosystem.

BlackRock, Inc Careers

Join the dynamic team at BlackRock, Inc, a premier global investment management firm, where innovation meets professional excellence. BlackRock offers unparalleled job opportunities in the finance sector, making it an ideal place for ambitious professionals to grow and excel. Work You’ll Do At BlackRock, Inc, you will be part of a culture that values diversity, leadership, and continuous growth. Engage in work that makes a real impact on the global economy, helping clients meet their investment goals while contributing to sustainable economic growth. Our team at BlackRock is composed of highly skilled professionals who lead the industry not just in assets under management but in ideas and innovation. Here, your skills will be honed through rigorous training and your career path will be as dynamic as the markets we navigate. BlackRock, Inc’s Leadership and Development Step into a role that challenges and excites with every project. BlackRock, Inc is not just hiring; we are building a future where every team member is equipped to lead. We believe in nurturing leadership through hands-on roles and comprehensive diversity training programs. Internship and Employment Opportunities Start your career with a BlackRock internship, where you will gain not just valuable work experience but also insights into our unique approach to investment management. Our internships are the first step to full-time employment, offering a deep dive into financial services with real responsibilities and learning opportunities. Benefits and Growth At BlackRock, Inc, we understand that our company’s success depends on the growth and satisfaction of our team. That’s why we offer competitive benefits designed to support your life, both at work and outside of it. From health and wellness to financial planning, we ensure our team is well taken care of. Innovation at Every Level Innovation is at the core of BlackRock, Inc. We invest in technology and ideas that redefine the boundaries of financial services. Our commitment to innovation is reflected in how we solve the industry’s biggest challenges and how we serve our clients. Networking and Professional Development Enhance your career with BlackRock’s expansive networking opportunities. Connect with industry leaders, participate in global forums, and collaborate with teams that champion creativity and forward-thinking. Our networking events are designed to foster connections that lead to groundbreaking solutions. Join Our Team Explore the job opportunities at BlackRock, Inc and find the position that matches your skills and ambitions. We are looking for curious, driven, and innovative individuals to join our team. Check out our open positions and prepare your resume for an exciting journey in the world of finance. Stay Connected Keep up to date with the latest from BlackRock, Inc Careers through our dedicated careers blog. Gain insider perspectives that can help you before, during, and after the interview process. Learn from the best and become a part of a company that’s shaping the future of finance. Job Alert Emails Personalize your subscription to receive job alerts and the latest news tailored to your preferences. Discover the rewarding career opportunities waiting for you at BlackRock, Inc. Join BlackRock, Inc and be part of a team that’s dedicated to creating a better financial future for our clients worldwide. Your path to professional excellence starts here.
Learn more about BlackRock, Inc
Market Cap
$105.5 billion
Industry
Finance & Insurance
Net Income
$4.9 billion
Founded
1988
5 Year Trend
+9.6%
Revenue
$16.2 billion
NASDAQ
BLK
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at BlackRock, Inc

More Information Technology Jobs

Find similar Data Engineer, Associate jobs:

NationwideNew York, NY