- Job Type: Full-Time
- Function: IT
- Industry: AI/ML
- Post Date: 09/04/2024
- Website: cyble.io
- Company Address: 1175 Cicero Dr, Alpharetta, Georgia 30022, US
About Cyble
Cyble provides capabilities for customers to manage cyber risks with AI-powered actionable threat intelligence. We are specialists in gathering intelligence across the Deepweb, Darkweb and Surface WebJob Description
Cyble Inc. is a Series B-funded startup that offers customers capabilities to manage cyber risks with AI-powered actionable threat intelligence. Our intelligence-gathering capabilities extend across Deepweb, Darkweb, and Surface Web. We have received recognition from Forbes and are backed by investors such as Y Combinator, Blackbird Ventures, Spider Capital, Xoogler Ventures, Picus Capital, Singtel Innov8, and Cathexis Ventures.
Role Description:
Cyble is seeking an expert Elasticsearch Engineer to optimize and scale our next-gen threat intelligence platform powered by Elasticsearch. You will lead the architecture, implementation, and 24x7 management of the petabyte-scale on-premise Elasticsearch clusters that feed our analytics applications.
Responsibilities:
- Design and deploy optimal Elasticsearch architecture considering factors like high availability, disaster recovery, security, costs, and dynamic scalability into billions of documents
- Establish comprehensive cluster management strategies including index lifecycle management, capacity planning, node provisioning, access control, backups, and more
- Continuously monitor 50+ node clusters; troubleshoot and resolve issues like node/shard failures, latency spikes quickly
- Tune Elasticsearch performance by analyzing query patterns, optimizing indexing, caching, JVM heap size etc. to meet SLAs
- Streamline Elasticsearch upgrades and new version testing through expert change management protocols
- Create highly reusable libraries of index templates, custom analyzers, scripts covering varied datatypes and use cases
- Collaborate with data engineers to construct efficient pipelines, crawlers, ETL jobs to maximize data quality and integrity
- Guide application developers on complex search, filtering, aggregation requirements and query optimization
- Automate cluster administration activities through Python/Bash scripts and Elasticsearch APIs
- Research and prototype new Elasticsearch features like AI-based relevance tuning, Graph capabilities
Requirements:
- 7+ years of Elasticsearch DBA/Architect level experience
- Successfully managed PB+ scale clusters with 100+ nodes
- Expert in areas like sharding strategies, memory optimization, security, deployment topologies
- Advanced scripting and automation skills using DevOps tools like Ansible
- Exceptional problem investigation skills with ability to dive deep into logs
- Strong communication and collaboration skills
- Relevant Engineering degree; Elasticsearch certifications a plus
We Offer:
- An empowering role in a forward-thinking cybersecurity company.
- An attractive compensation package, including a competitive base salary, bonuses, and other incentives.
- Comprehensive benefits package and opportunities for career advancement.
- A culture that values innovation, integrity, and inclusivity.
Compensation and Incentives:
We offer a highly lucrative compensation package for the right candidate, including a competitive salary, performance bonuses, and options. Our benefits package includes comprehensive health care, generous paid time off and others. We believe in rewarding excellence and commitment and providing incentives that reflect the significant impact of this role on our company’s success