About the role
We are looking for a Infrastructure Engineer (Kafka) to own and operate the Kafka estate behind an event-driven integration platform, including its build, deployment, and monitoring infrastructure.
The mandatory requirements are 4+ years of hands-on production Kafka experience, strong Linux and Python scripting, CI/CD, Docker or Podman, infrastructure-as-code, and strong English communication skills.
Must haves
- Deep, hands-on production Kafka experience of at least 4+ years — this is the central requirement. Topic and partition design, consumer group mechanics, retention and compaction, replication, performance tuning, and troubleshooting lag, rebalances and delivery failures under load.
- Practical understanding of event-driven delivery semantics: at-least-once versus exactly-once, idempotency, ordering guarantees, dead-letter handling and replay.
- Strong enterprise Linux engineering and automation — shell plus Python scripting.
- CI/CD pipeline ownership, ideally Jenkins declarative pipelines, with real artifact and release management experience.
- Containers — Docker or Podman, OCI images — and container orchestration platforms.
- Infrastructure-as-code and configuration management.
- Observability tooling: log aggregation, metrics, alerting and SLO definition.
- GenAI-assisted development — you actively use AI coding agents in your daily workflow, or are demonstrably keen to adopt them. We automate and build with these tools across the squad and expect everyone to be fluent in them.
- Networking, TLS, secrets management and enterprise authentication (OAuth2).
- A production operations mindset: incident response, capacity planning and change control.
- Strong written and verbal communication, working with a global team.
- Upper-intermediate English level.
Nice to haves
- Kafka ecosystem depth: Kafka Connect, Schema Registry, Kafka Streams, MirrorMaker, or managed Kafka services.
- Change-data-capture patterns and tooling.
- Infrastructure supporting large commercial SaaS platforms, including integration gateway or connector servers.
- Package and artifact distribution at enterprise scale.
- Experience in a regulated environment — audit retention, data classification, formal build and operate governance.
- Kubernetes; multi-region and high-availability design.
What you will do
- Own the Kafka estate — topic design and naming standards, partitioning and keying strategy, replication, retention and compaction policy, consumer group and offset management, quotas, and broker configuration and upgrades.
- Ensure platform resilience and reliability — keep the integration platform available when the upstream vendor SaaS platform is degraded or unavailable, absorb traffic spikes without overloading it, and ensure events remain replayable and auditable through a correctly sized, configured and operated Kafka infrastructure.
- Engineer the platform's delivery guarantees in practice: at-least-once and exactly-once semantics, idempotent producers, transactional writes where warranted, dead-letter topics, and self-service replay tooling for recovering from downstream failures.
- Build streaming observability: consumer lag, queue depth, throughput and rebalance monitoring; end-to-end correlation-ID tracing across topics; dashboards, service level objectives and alerting.
- Plan capacity, cost and retention for a durable log with regulatory audit retention requirements, and tune it as adoption scales across the firm.
- Evaluate and integrate vendor-native streaming and change-data-capture mechanisms as the platform's ingress and egress paths mature.
- Own and evolve the build and release pipeline — automated Jenkins pipelines producing packaged application installs for multiple enterprise Linux generations, signed container images, and generated documentation, promoted through internal artifact and image distribution services.
- Operate the runtime estate: containerised deployments, integration gateway hosts, and the ongoing operating-system modernisation of that estate.
- Engineer the infrastructure behind the platform's resilience and continuity — health detection, circuit breaking, and the reconciliation and monitoring that prove the platform recovers cleanly when the upstream vendor platform is degraded or unavailable.
- Automate environment provisioning and configuration, and keep the configuration and asset inventory a genuine single source of truth.
- Partner with the squad's Python developers on deployability, performance and cost; participate in change management and production support.
Perks
- Growth without limits: build your skills through mentorship, internal TechTalks, challenging projects, and a dedicated annual learning budget
- Competitive compensation: get recognition that reflects your skills and impact, with regular performance and compensation reviews
- Flexibility: work 100% remotely with flexible hours that support focus, autonomy, and a healthy work rhythm
- Meaningful, modern projects: build impactful products using modern technologies alongside global teams and leading brands
- Collaborative culture: join a supportive environment with zero micromanagement where ideas are welcomed and contributions are recognized
- Well-being & support: access local well-being programs and people-focused support tailored to your location
Didn’t find the perfect fit?
Subscribe to get notified about new roles that match your skills and interests.
Hiring process timeline
We designed our hiring process to be fast, transparent, and convenient — so you always know what to expect and can move through the steps without unnecessary delays.
A quick note
After applying, keep an eye on your inbox — including your spam folder. Occasionally, emails from our hiring platform, LaunchPod, may land there.
Tell us about yourself
Submit a short application form.
Pass a quick test
Pass a 30’- 60’ test.
Record a short video
Introduce yourself on video to fast-track your application process.
Meet our team
Once you pass the video review, grab a spot on our calendar for a technical interview.
Get an offer
Welcome to AgileEngine!
Have any questions?
What is the work format and schedule?
We are a remote-first company, so all our positions are remote. Schedules are flexible, but the main requirement is to have an overlap with your client’s schedule to ensure smooth collaboration. Specific details depend on the project and are discussed during the interview process.
What level of English is required?
We look for Upper-Intermediate (B2) proficiency or higher. Since you will be collaborating with international teams and global clients (including Fortune 500 companies), English is a part of your daily work.
Does AgileEngine provide work equipment?
It depends on your location. We provide equipment in Ukraine, Poland, Argentina, Colombia, Mexico, Brazil, Guatemala, Portugal, Spain, and India. In the USA, equipment is usually provided by the client; otherwise, you will be expected to use your own setup.
What opportunities for professional growth do you offer?
We support continuous growth through personalized development paths tailored to each expert. Also, you can expect:
- An annual learning and development budget
- Internal workshops, tech talks, and mentorship programs
- Opportunities to switch projects or grow into new roles over time
What does a typical team look like, and what tools do you use?
Teams vary by project, but you’ll usually work with a mix of experts across different fields, along with a delivery or project manager who supports collaboration and onboarding.
For day-to-day work, teams commonly use tools like Jira and Google Workspace, along with communication platforms such as Google Chat. Depending on the client, you may also work with Slack, Confluence, Notion, or similar tools.
Need help?
Want more details? See full FAQ
If something doesn’t work or you have questions regarding your application process, drop us a line.