Affinity

4464 Data Engineer

Affinity$100K — $140K *
Information Technology
8 - 10 years of experience
Job Overview by Ladders

Qualifications

  • Bachelor's degree with 8 years of relevant experience.
  • Active IAT Level II certification (e.g. CompTIA Security+) and CSSP Infrastructure Support (e.g. CompTIA Cloud+) required by onboarding date.
  • Certifications such as CompTIA CySA+, EC-Council CND, GICSP, or (ISC)2 SCCP are highly relevant.
  • Proven experience with stream processing and real-time log enrichment is essential.
  • Hands-on expertise with schema normalization frameworks (OCSF or ECS) required.
  • Comprehensive knowledge of cloud data lakehouse design and Parquet/object storage optimization.
  • Familiarity with AI coding tools (especially frontier LLMs) is an important asset.

Responsibilities

  • Build and manage high-throughput telemetry routing and stream processing systems.
  • Implement real-time log parsing, filtering, and enrichment pipelines.
  • Standardize security logs using schemas like OCSF and ECS.
  • Design and optimize cloud data lakehouses focusing on data storage innovations.
  • Leverage AI tools to enhance data pipeline efficiency and log parser development.

Benefits

  • Active Top Secret clearance is a requirement for this role.
  • Work in a collaborative environment with cutting-edge technology.
  • Opportunity to make significant contributions to security operations and threat detection.
  • Engage in advanced AI integration projects related to data processing.
Full Job Description
4464 Data Engineer
4464 | Top Secret

Job Description:

OVERVIEW:

We are seeking a Cyber Data & Telemetry Engineer to build and scale our next-generation security data pipelines. You will design real-time streaming architectures, normalize critical security schemas, and optimize our cloud data lakehouse to empower security operations and threat hunting.

GENERAL DUTIES:

  • Stream Processing: Build and manage high-throughput telemetry routing and stream processing systems.
  • Log Management: Implement real-time log parsing, filtering, and enrichment pipelines.
  • Schema Normalization: Standardize disparate security logs using open frameworks like OCSF and ECS.
  • Data Architecture: Design and optimize cloud data lakehouses, focusing on Parquet and object storage architectures.
  • AI Integration: Leverage frontier large language models to accelerate data pipeline development, log parser generation, and query optimization.
  • Primary Languages & Technical Stack: SQL, KQL, and Python (at least one required)


REQUIRED QUALIFICATIONS:

  • Bachelor's degree and 8 years of experience related to specific functional area.
  • Active certifications for both IAT Level II (e.g. CompTIA Security+) and Cyber Security Service Provider (CSSP) Infrastructure Support (e.g. CompTIA Cloud+) by program onboarding date.
  • The following individual certifications cover both certification requirements for this program: CompTIA Cybersecurity Analyst, CySA+; EC-Council Certified Network Defender (CND); GlAC Global Industrial Cyber Security Professional, GICSP; (ISC)2 System Security Certified Practitioner (SCCP).
  • Hands-on experience and knowledge with the following:
  • Proven experience with stream processing, telemetry routing, and real-time log enrichment.
  • Hands-on experience with schema normalization frameworks such as OCSF or ECS.
  • Deep understanding of cloud data lakehouse design and Parquet/object storage optimization.
  • Frontier LLMs: Familiarity with AI coding tools and LLMs


DESIRED QUALIFICATIONS:

  • Extensive experience with AI coding tools and LLMs: (ChatGPT, Grok, Claude, Claude Code, Codex)
  • Multiple scripting and development languages
  • Deep understanding of data normalization into SIEM/Data Lake


CLEARANCE:

  • Active Top Secret clearance minimum required


Job Details

City : Reston

State : Virginia

About Affinity

Affinity’s patented technology structures and analyzes millions of data points across emails, calendars, and third-party sources to offer users the tools they need to automatically manage their most valuable relationships, prioritize important connections, and discover untapped opportunities. Affinity uses artificial intelligence to analyze relationship strength and illuminate the best paths to warm introductions. The platform also offers a holistic view of users’ networks in a centralized, automatically updated database without any manual upkeep. Founded in 2014, Affinity is headquartered in San Francisco, California. Affinity has raised $120M to date and is backed by leading investors including Menlo Ventures, Advance Venture Partners, 8VC and MassMutual Ventures. It has over 2,700 customers in 70 countries, including venture capital firms such as Bain Capital Ventures and Kleiner Perkins, private equity firms such as SoftBank Group, investment bankers such as Woodside Capital Partners, financial services firms such as Fidelity Investments, real estate companies such as Tishman Speyer, insurers such as American Family Insurance and enterprises such as Nike, Qualcomm and Twilio. Affinity has been named in Fortune Magazine's Best Workplaces, Inc. Magazine's Best Workplaces and editor's number one pick, the Data Breakthrough Award, BIG Innovation Award and others.
Learn more about Affinity
Size
1,000 employees
Industry
Founded
2014

Similar Jobs

More Jobs at Affinity

  • Affinity
    4464 Data Engineer
    $100K — $140K *
    Reston, VA 20191 (Fairfax County)
    Information Technology
    In-Person
  • Affinity
    4455 Senior Program Manager
    $120K — $150K *
    Washington, DC 20011 (District Of Columbia County)
    Aerospace & Defense
    In-Person
  • Affinity
    4453 SETA Program Manager
    $120K — $150K *
    Arlington, VA 22204 (Arlington County)
    Aerospace & Defense
    In-Person
  • Affinity
    4454 Director of Client Success
    $130K — $180K *
    Washington, DC 20011 (District Of Columbia County)
    Aerospace & Defense
    In-Person
  • Affinity
    4456 Program Manager
    $90K — $130K *
    Washington, DC 20011 (District Of Columbia County)
    Aerospace & Defense
    In-Person

More Information Technology Jobs

Find similar 4464 Data Engineer jobs: