Kafka Admin

Job Description:

•Standing up and administer on premise Kafka cluster.

•Ability to architect and create reference architecture for kafka Implementation standards

• Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.

• Ensure optimum performance, high availability and stability of solutions.

• Create topics, setup redundancy cluster, deploy monitoring tools, alerts and has good knowledge of best practices.

• Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms.

• Provide administration and operations of the Kafka platform like provisioning, access lists Kerberos and SSL configurations.

• Use automation tools like provisioning using Docker, Jenkins and GitLab.

• Ability to perform data related benchmarking, performance analysis and tuning.

• Strong skills in In-memory applications, Database Design, Data Integration.

• Involve in design and capacity review meetings to provide suggestion in Kafka usage.

• Solid knowledge of monitoring tools and fine tuning alerts on Splunk, Prometheus, Grafana ,Splunk.

• Setting up security on Kafka.

• Providing naming conventions, Backup & Recovery and problem determination strategies for the projects.

• Monitor, prevent and troubleshoot security related issues.

• Provide strategic vision in engineering solutions that touch the messaging queue aspect of the infrastructure

QUALIFICATIONS

• 4-6 years demonstrated proficiency and experience in design, implementation, monitoring, and troubleshooting Kafka messaging infrastructure.

• Hands on experience on recovery in Kafka.

• 2 or more years of experience in developing/customizing messaging related monitoring tools/utilities.

• Good Scripting knowledge/experience with one or more (ex. Chef, Ansible, Terraform).

• Good programming knowledge/experience with one or more languages (ex. Java, node.js, python)

• Considerable experience in implementing Kerberos Security.

• Support 24*7 Model and be available to support rotational on-call work ( including Saturday/Sunday )

• Competent working in one or more environments highly integrated with an operating system.

• Experience implementing and administering/managing technical solutions in major, large-scale system implementations.

• High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy.

• Ability to manage tasks independently and take ownership of responsibilities

• Ability to learn from mistakes and apply constructive feedback to improve performance

• Ability to adapt to a rapidly changing environment.

• Proven leadership abilities including effective knowledge sharing, conflict resolution, facilitation of open discussions, fairness and displaying appropriate levels of assertiveness.

• Ability to communicate highly complex technical information clearly and articulately for all levels and audiences.

• Willingness to learn new technologies/tool and train your peers.

• Proven track record to automate.