What It Was#
Migration Manager was an in-house client/server platform built at Hawaiian Airlines to migrate FluentBit log exporter configurations from a legacy log repository (ElasticSearch on AWS) to its replacement (AWS OpenSearch) — across a fleet of 100+ systems, without downtime.
The core challenge: each system had its own repository credentials, index names, and identity. A bulk migration that steamrolled those details wasn’t an option. Migration Manager scheduled and processed requests individually, refreshing credentials and regenerating or creating replacement-side indexes per system while preserving the source system’s identity and index naming.
What It Did#
- Client agent — deployed on each target system; written in Rust and compiled for both Windows Server and RedHat RHEL 8/9, covering the full heterogeneous fleet
- Server-side orchestration — received and scheduled migration requests, coordinated credential refresh, managed OpenSearch index creation/regeneration
- Zero-downtime constraint — migrations were processed within a tight window so log continuity was preserved throughout the transition
- Credential management — client-side ElasticSearch credentials and OpenSearch-side credentials were handled and rotated as part of the migration flow
Why It Was Built#
Migrating a logging infrastructure at scale is straightforward when all your systems are identical. When you have a mix of Windows Server and RHEL machines — each with their own FluentBit config, credentials, and established index names — the problem becomes a coordination challenge. This solution provided a repeatable, auditable path through it.
Outcome: Zero-downtime log migration capability across 100+ systems, purpose-built for a heterogeneous environment.
Tech: Rust, Python / FastAPI, Kubernetes, AWS OpenSearch
Context: Hawaiian Airlines (2025)
