| Job Information |
Our client is looking for a Senior Software Engineer to join their team and help build and maintain our Kafka and AWS-based data pipelines. You will be responsible for designing, developing, and deploying scalable and reliable systems that can handle high volumes of data. You will also work closely with other engineers to ensure that data pipelines are integrated with existing systems and meet the needs of the business.
Responsibilities:
- Design, develop, and deploy Kafka-based data pipelines
- Work with AWS services to manage and process data
- Monitor and optimize Kafka clusters
- Troubleshoot Kafka related issues
- Work with other engineers to ensure that data pipelines are integrated with existing systems and meet the needs of the business
- Mentor and train junior engineers
Qualifications:
- 5+ years of experience in software development
- 3+ years of experience with Kafka
- 3+ years of experience with AWS
- Strong understanding of distributed systems and streaming data technologies
- Excellent programming skills in Java or a similar language
- Experience with cloud computing platforms such as AWS
- Experience with CI/CD pipelines
- Excellent problem-solving and analytical skills
- Ability to work independently and as part of a team
Bonus Points:
- Experience with Confluent Platform
- Experience with Apache Spark, Apache Flink, or Apache Storm
- Experience with Hadoop and MapReduce
- Experience with Kafka Streams and Kafka Connect
- Experience with AWS Managed Streaming for Kafka (MSK)
Benefits:
- Competitive salary and benefits package
- Opportunity to work on challenging and innovative projects
- Collaborative and supportive work environment
- Opportunities for professional development and growth
If you are a talented and experienced software engineer with a passion for Kafka and AWS, we encourage you to apply.
|
