Key Business Solutions

Receive alerts when this company posts new jobs.

Similar Jobs

Job Details

Database Developer with Elasticsearch clusters,Kafka

at Key Business Solutions

Posted: 11/17/2019
Job Reference #: 12430779
Keywords: technology

Job Description

Database Developer with Elasticsearch clusters,Kafka
Houston, TX
Duration – 6-12 Months + extension

Job Responsibilities
Designing, operationalizing, maintaining and scaling production Kafka clusters.
Responsible for Kafka tuning, capacity planning, disaster recovery, replication, and troubleshooting.
Implementing Kafka security, limiting bandwidth usage, enforcing client quotas, backup and restoration.
In-depth understanding of the internals of Kafka cluster management, Zookeeper, partitioning, schema registry, topic replication and mirroring.
Architect, configure, deploy and maintain Elasticsearch clusters.
Architect and deploy Elastic Cloud Enterprise.
Configure Logstash and Beats to collect data necessary to meet client requirements.
Configure X-Pack plugins to include Security, Watcher, Machine Learning, Monitoring, Graph, and Reporting.
Design, implement, and configure Kibana visualizations and dashboards.
Modernizing ETL pipelines through the use of Kafka and Elastic.
Maintaining Kafka connectors to move data between systems.
Working with enterprise architects to advise on best practices for Kafka & Elasticsearch both on prem and in the cloud.
Experience training, mentoring and leading an emerging team is beneficial.
Knowledge of Cloud Formation/Terraform scripts.
Work closely with Big Data and AWS cloud technology groups.
Experience with open source Kafka distributions as well as enterprise Kafka products preferred.
Familiarity with both cloud native Kafka (on AWS) and on-premise architectures.
Managing Kafka & Elasticsearch clusters & creating tools to automate and improve clusters' reliability and performance.
Design and implement DR solutions for Confluent and Apache Kafka and Elasticsearch.
Lead and participate in OnCall rotation for production support.

Required
BS in Computer Science and/or equivalent work experience (8-10 years' DBA experience).
Strong data analysis skills; ability to independently write scripts/code to parse and analyze complex data.
Excellent verbal and written communication skills.
Communicate and work effectively in a team environment.
3+ years of experience architecting and implementing Kafka clusters in a large-scale enterprise environment.
3+ years of experience with Elastic (Elastic Search, Logstash, Kibana) in a large-scale enterprise environment.
3+ years of experience supporting Linux environments.
3+ years of experience with Shell scripting.
Successful completion of interview required to meet job qualification.
Reliable, punctual attendance is an essential function of the position.

Preferred
Field and document modeling for fast and efficient searching and loading.
Experience with configuration management tools like Ansible is a plus
Kiran Kumar
Key Business Solutions, Inc.
|| Office: 916 646 2080 Ext 224 ||