Bloomberg

Web Scraping Engineer (U.S. Citizen)

Bloomberg • $95K — $105K *
US-Anywhere
+ 2 other locationsRemote
Information Technology
Less than 5 years of experience
Today
Be an Early Applicant
Job Overview by Ladders

Qualifications

  • U.S. Citizen required; dual citizenship not permitted.
  • Minimum of 3 years of web scraping experience.
  • Proficient in Python and Java; experience with web scraping libraries.
  • Knowledge of HTML, CSS, and JavaScript essential for navigation.
  • Familiarity with APIs and data formats like JSON and XML.

Responsibilities

  • Develop and maintain web scraping tools and scripts.
  • Collaborate with teams to define data extraction needs.
  • Monitor and troubleshoot scraping processes for data accuracy.
  • Optimize scripts for speed, scalability, and resource utilization.
  • Conduct data analysis to ensure the integrity of scraped data.

Benefits

  • Remote work opportunity available for DMV area residents.
  • Potential for collaboration with data engineering and data science teams.
  • Involvement in cutting-edge web scraping techniques and best practices.
Full Job Description
Job Type

Full-time

Description

NOTE: This is a full-time employment opportunity (No C2C, subcontractor or 1099 engagements, please.). The candidate MUST be a U.S. Citizen and able to complete/pass/hold at a minimum public trust investigation (active public trust is preferred). This is a remote opportunity; however, candidate must reside in the DC, Maryland, Virginia (DMV) metro area.

Daily Responsibilities
  • Support the development and maintenance of the agency's web scraping infrastructure. Responsible for extracting data from various websites and APIs, ensuring data quality and accuracy, and optimizing the scraping process for efficiency. Duties include:
  • Develop and maintain web scraping scripts and tools to extract data from websites and APIs.
  • Collaborate with cross-functional teams to understand data requirements and implement scraping solutions accordingly.
  • Monitor and troubleshoot scraping processes to ensure data quality and accuracy.
  • Optimize scraping scripts for performance and efficiency, considering factors such as speed, scalability, and resource utilization.
  • Stay up to date with the latest web scraping techniques, tools, and best practices.
  • Conduct data analysis and validation to ensure the integrity of scraped data.
  • Collaborate with data engineering and data science teams to integrate scraped data into our data pipelines and systems.
  • Document and communicate technical solutions, processes, and best practices to team members.


Requirements

  • Must be a U.S. Citizen (no dual status) as mandated by our government client.
  • Must be able to complete/pass/hold at a minimum public trust investigation (an active public trust is preferred).
  • This is a remote opportunity; however, candidate must reside in the DMV area (as mandated by our government client).
  • 3+ years of professional experience in web scraping or a similar role.
  • Proficiency in Python and Java and experience with web scraping libraries such as Beautiful Soup, Scrapy, or Selenium.
  • Knowledge of AI/machine learning techniques for data extraction and classification.
  • Understanding of HTML, CSS, and JavaScript to navigate and interact with websites.
  • Experience working with APIs and handling different data formats (JSON, XML, etc.).
  • Familiarity with database systems and SQL for data storage and retrieval.
  • Familiarity of data cleaning and preprocessing techniques to ensure data quality.
  • Strong problem-solving skills and ability to troubleshoot and debug scraping issues.
  • Excellent communication and collaboration skills to work effectively in a team environment.
  • Attention to detail and ability to handle large volumes of data efficiently.
  • BS/BA degree in Computer Science, Information Sciences, or related IT discipline. Additional years of related professional experience can be substituted for a BS/BA degree.


Additional Qualifications (a PLUS):
  • Experience with cloud platforms for scalable web scraping infrastructure.
  • Familiarity with data visualization tools and techniques.
  • Understanding of legal and ethical considerations related to web scraping.


Compensation decisions depend on a wide range of factors, including but not limited to skill sets, experience and training, security clearances, licensure and certifications, location, and other business and organizational needs.

Salary Description

95,000-105,000

About Bloomberg

Bloomberg L.P. is a privately held financial, software, data, and media company headquartered in Midtown Manhattan, New York City. It was founded by Michael Bloomberg in 1981, with the help of Thomas Secunda, Duncan MacMillan, Charles Zegar, and a 12% ownership investment by Merrill Lynch. Bloomberg L.P. provides financial software tools and enterprise applications such as analytics and equity trading platform, data services, and news to financial companies and organizations through the Bloomberg Terminal (via its Bloomberg Professional Service), its core revenue-generating product. Bloomberg L.P. also includes a wire service (Bloomberg News), a global television network (Bloomberg Television), digital websites, a radio station (WBBR), subscription-only newsletters, and three magazines: Bloomberg Businessweek, Bloomberg Markets, and Bloomberg Pursuits.
Learn more about Bloomberg
Size
20,000 employees
Industry
Media
Founded
1981
* Ladders Estimates

Similar Jobs

Ad banner background

Get Ready For Your
Next Interview

More Jobs at Bloomberg

More Information Technology Jobs

Find similar Web Scraping Engineer (U.S. Citizen) jobs:

NationwideRemote