About the RoleAs a
Software Developer (Content Integration & Data Pipelines), you will design, build, and scale the production-grade pipelines that collect, process, and deliver online news and web content across our platform. You will play a key role in shaping how content flows from thousands of sources into our search and analytics systems - powering the monitoring, insights, and AI-driven features PR professionals rely on every day.
This role goes beyond implementation. You will contribute to system design, architecture decisions, and data strategy, helping define how content is acquired, normalized, enriched, and indexed at scale using event-driven design.
You'll work across both:
- Content acquisition and integration (TypeScript, web scraping and crawling, source integrations)
- Backend and pipeline systems (Java, event-driven architecture with Kafka, search indexing with Solr)
Agility PR Solutions is building next-generation media intelligence capabilities powered by AI. Your work will directly influence how customers extract insights, automate workflows, and make decisions from large-scale media data
What you'll do- Build and maintain scalable web scrapers and crawlers that follow web scraping standards and best practices (robots.txt, rate limiting, polite crawling)
- Develop content integration and parsing logic using TypeScript
- Design and build event-driven services using Kafka to process, enrich, and route content in near real time
- Integrate with third-party content providers, feeds (RSS/Atom), and external APIs
- Design and implement RESTful services (Java) to support content processing and delivery
- Define and enforce best practices for:
- Scraping compliance and source management
- Pipeline reliability, error handling, and data quality
- Observability and monitoring of content pipelines
- Optimize performance, cost, and reliability of pipeline workloads
- Contribute to architectural decisions and technical direction
- Mentor junior developers and contribute to team knowledge sharing
What You'll Bring - Degree in Computer Science or related field (or equivalent experience)
- 3+ years of software development experience
- Proficiency in TypeScript / JavaScript
- Solid experience building backend services (Java or similar)
- Hands-on experience with web scraping and crawling in production environments, including adherence to web scraping standards (robots.txt, rate limiting, terms of use)
You should have practical experience with:- Event-driven architecture and message streaming (e.g., Kafka)
- HTML parsing, content extraction, and normalization techniques
- Designing high-volume, fault-tolerant data pipelines
Experience with:- SQL and data modeling
- Linux environments
- Git, and modern development workflows
- Kafka
- Maven
- Knowledge of Solr (indexing, schema design, query tuning) is an asset
Strongly preferred:- Experience building content ingestion pipelines for news or media data
- Understanding of system design and scalability tradeoffs
- Ability to work independently and take ownership of projects
- Strong problem-solving and system design thinking
- Effective communication across technical and non-technical stakeholders
- Passion for data, automation, and emerging technologies, including AI
Why You'll Love It Here - Fully remote work environment
- Collaborative culture - and key tools enabling it
- Competitive compensation package
- Health, Dental & Vision benefits
- RRSP matching
- Life Insurance
- Employee Assistance Program (EAP)
- Career Development & Progression opportunities
- Paid Vacation, Personal Days and Sick days
- Week off between Christmas and New Years'
- No Internal Meetings Fridays
Compensation for this role is expected to fall within the range of
$75,000 - 110,000 annually. The final offer will reflect each candidate's experience, skills, and internal equity.
This is for a vacant position.
