Use case
Monitoring Deployment on Amazon EKS Fargate
- Dhruv Bardolia
About the Customer
Illuminate Tech is a technology company specializing in cloud infrastructure and microservices architecture. Their focus is on delivering scalable, efficient solutions tailored to optimizing business operations, with an emphasis on cloud-native services and robust CI/CD pipelines.
Customer Challenge
The organization wanted to migrate its microservices infrastructure from Amazon EKS EC2 to Amazon EKS Fargate to optimize costs and improve resource utilization. However, Amazon EKS Fargate presented a key challenge: it does not support DaemonSets, which are typically used for deploying agents that handle logging and monitoring across all nodes. This limitation necessitated an alternative solution to maintain observability, ensure effective log management, and prevent storage exhaustion on Fargate nodes, which have a 20GB storage limit.
Solution
To address the challenge of monitoring and logging in the absence of DaemonSets, IAMOPS implemented a sidecar container architecture to handle log collection and rotation on Amazon EKS Fargate. The solution involved:
- Logging: The application microservices write logs to a shared volume mounted in each Fargate pod. A Fluentd sidecar container reads logs from the shared volume and forwards them to Coralogix, the chosen logging and monitoring platform.
- Log Rotation: A logrotate sidecar container was deployed alongside Fluentd to handle log rotation every 15 minutes, preventing storage exhaustion on the Fargate node’s limited disk space.
- Monitoring: The team deployed the OpenTelemetry (OTEL) collector as a standalone service (rather than as a DaemonSet) to fetch and collect metrics from the application services. These metrics were sent to Coralogix for visualization and alerting.
This architecture allowed the team to maintain effective logging and monitoring without the need for DaemonSets, overcoming the limitations imposed by Fargate.
Semantic Release Workflow
Results & Benefits
- Cost Optimization: By migrating from EKS EC2 to EKS Fargate, the infrastructure became more cost-efficient. Fargate’s serverless model enabled dynamic scaling based on demand, resulting in reduced overhead from overprovisioned resources.
- Enhanced Monitoring and Logging: The solution ensured continuous observability through the use of Fluentd and OTEL collectors, even in a Fargate environment, which does not support DaemonSets.
- Effective Storage Management: The implementation of logrotate as a sidecar container allowed for automatic log rotation, mitigating the risk of storage exhaustion on the Fargate nodes.
- Incident Management: Alerts were set up in Coralogix to notify the team via Slack in case of storage issues or metric threshold breaches, improving incident response times.
About IAMOPS
IAMOPS is a full DevOps suite company that supports technology companies to achieve intense production readiness.
Our mission is to ensure that our clients’ infrastructure and CI/CD pipelines are scalable, mitigate failure points, optimize performance, ensure uptime, and minimize costs.
Our DevOps suite includes DevOps Core, NOC 24/7, FinOps, QA Automation, and DevSecOps to accelerate overall exponential growth.
As an AWS Advanced Tier Partner and Reseller, we focus on two key pillars: Professionalism by adhering to best practices and utilizing advanced technologies, and Customer Experience with responsiveness, availability, clear project management, and transparency to provide an exceptional experience for our clients.
