Description:Columbia Technology Partners is seeking a Cloud Software Engineer to design, build, and enhance complex big data cloud systems supporting high-demand, mission-driven environments. This role focuses on backend development, distributed processing, and information retrieval, leveraging modern cloud and big data technologies. You'll contribute across the full software development lifecycle, helping to architect scalable solutions, optimize performance, and improve data processing capabilities in cloud-native environments.
Key Responsibilities:- Design, develop, and maintain backend components supporting big data cloud systems
- Implement distributed processing workflows, including MapReduce-based analytics and data pipelines
- Develop software that interacts with cloud-based distributed file systems, coordination services, and storage frameworks
- Apply Information Retrieval (IR) principles to support indexing, search, and data access solutions
- Collaborate with engineers to translate system-level requirements into scalable software components
- Review, test, and validate software to ensure alignment with design requirements and performance expectations
- Troubleshoot and resolve software issues, providing root cause analysis and corrective actions
- Support system design decisions, including tool selection, COTS/GOTS integration, and performance optimization
- Contribute to process improvements, documentation, and development standards
Qualifications: - Bachelor's degree in Computer Science or related field (or equivalent experience); 8+ years of software engineering experience, including work with cloud and distributed systems
- Experience developing software for big data or distributed computing environments, including Information Retrieval, MapReduce, and cloud-based data processing
- Hands-on experience with cloud and big data technologies/tools such as Elastic/Elasticsearch, Hadoop ecosystem (HDFS, YARN, HBase), and programming in Java/Python with modern frameworks (Spring Boot, NiFi, etc.)
Desired Qualifications: - Experience with DevOps practices and CI/CD pipelines
- Familiarity with search/indexing technologies (Lucene, Solr)
- Knowledge of distributed coordination frameworks (e.g., Zookeeper)
- Experience working in Linux environments (CentOS/RHEL)
- Exposure to SIGINT or mission-centric data analysis environments
Requirements: - U.S. Citizenship is required for all applicants. CTP is an equal opportunity employer and abides by applicable employment laws and regulations. All applicants and employees are subject to random drug testing in accordance with Executive Order 12564. Employment is contingent upon successful completion of a security background investigation and polygraph.
- Certification Requirements:
This position requires an active Security Clearance with appropriate Polygraph. 
