Big Data Engineer BDE21-1

DataSync

$90K — $130K *
Information Technology
Less than 5 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's Degree in Computer Science or related field required.
  • Demonstrated success in data management with an emphasis on execution and detail.
  • Proficiency in programming languages such as Python, Spark, Kafka, or Java.
  • Experience handling large volumes of structured and unstructured data from diverse sources.
  • Proactive in exploring solutions to data mining challenges and employing best practices.
  • Familiarity with Data Lakes is advantageous.
  • Must hold an active government security clearance and appropriate poly, U.S. citizenship required.

Responsibilities

  • Gather and process raw data at scale.
  • Design and develop data applications using relevant tools and frameworks.
  • Extract, transform, stage, and load data to designated tools as needed.
  • Write scripts, perform web scraping, call APIs, and execute SQL queries.
  • Transform unstructured data into analyzable formats.
  • Monitor data performance and adjust infrastructure accordingly.
  • Define and implement data retention policies.

Benefits

  • Opportunities for career evolution and skill enhancement.
  • Exposure to cutting-edge big data technologies and innovations.
  • Collaboration with a diverse range of clients and industry leaders.
  • Engagement in a culture that values proactive problem solving.
  • Access to continuous learning resources and training programs.
Full Job Description
We are in search of a Big Data Engineer who can seamlessly mesh tech know-how with business acumen to help us navigate our clients big data computing needs. Not only are you experienced in cloud-based tech, but you have a firm grasp of platforms and applications, and have knowledge of how best to customize these attributes to our customers business demands. Not only can you help us connect the dots and evolve our capabilities over time, but you are also evolving your own capabilities as an engineer and keeping an eye on developments.

Big Data Engineer Responsibilities
  • Gather and process raw data at scale.
  • Design and develop data applications using selected tools and frameworks as required and requested.
  • Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
  • Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
  • Process unstructured data into a form suitable for analysis.
  • Monitoring data performance and modifying infrastructure as needed.
  • Define data retention policies.

Big Data Engineer Requirements
  • Bachelors Degree or more in Computer Science or a related field.
  • A solid track record of data management showing your flawless execution and attention to detail.
  • Programming experience, ideally in Python, Spark, Kafka or Java , and a willingness to learn new programming languages to meet goals and objectives.
  • Experience processing large amounts of structured and unstructured data, including integrating data from multiple sources.
  • A willingness to explore new alternatives or options to solve data mining issues, and utilize a combination of industry best practices, data innovations and your experience to get the job done.
  • Experience with Data Lakes a plus.

ONLY CANDIDATES WITH ACTIVE GOVERNMENT SECURITY CLEARANCES AND APPROPRIATE POLY WILL BE CONSIDERED. MUST BE A U.S. CITIZEN.

Interested in Joining Our Team? - Check out this YouTube video!

Similar Jobs

More Jobs at DataSync

More Information Technology Jobs

Find similar Big Data Engineer BDE21-1 jobs: