Use case
Efficient Microservices Scaling with KEDA
- Dhruv Bundheliya
About the Customer
Illuminate Tech is a leading provider of advanced data analytics solutions. They support organizations in harnessing the power of data to drive better decision-making through innovative tools and platforms. Illuminate Tech’s platform demands high scalability and flexibility to manage its microservices infrastructure efficiently.
Customer Challenge
Illuminate Tech required an autoscaling solution for its microservices running on Kubernetes. The challenge was to implement a scalable and cost-efficient system that could dynamically adjust the number of active instances based on BullMQ metrics stored in Redis. The absence of such a solution resulted in resource over-provisioning and unnecessary costs.
Solution
IAMOPS implemented KEDA (Kubernetes-based Event Driven Autoscaler) to manage the dynamic scaling of Illuminate Tech’s microservices. KEDA’s event-driven architecture allowed for scaling based on custom metrics from Redis, providing fine-tuned control over microservices scaling.
The implementation involved several steps:
- Deploying KEDA using Helm charts in the Kubernetes cluster.
- Defining the ScaledObject CRD to manage scaling rules based on BullMQ metrics.
- Configuring Redis as an event source for KEDA to trigger autoscaling events.
- Integrating these configurations with the custom Helm chart for seamless deployment and management of the microservices.
The following diagram illustrates the scaling mechanism implemented using KEDA:
Semantic Release Workflow
Results & Benefits
The implementation of KEDA delivered several key benefits:
- Improved Resource Utilization: By scaling microservices based on queue metrics, resources were only utilized when necessary, leading to significant cost savings.
- Enhanced Performance: The autoscaling mechanism allowed for quick responses to workload spikes, ensuring minimal delay in scaling.
- Operational Efficiency: The automation reduced manual intervention, enabling the DevOps team to focus on other high-priority tasks.
- Future Scalability: The KEDA integration set a scalable framework for future microservices expansions, enhancing overall infrastructure scalability.
About IAMOPS
IAMOPS is a full DevOps suite company that supports technology companies to achieve intense production readiness.
Our mission is to ensure that our clients’ infrastructure and CI/CD pipelines are scalable, mitigate failure points, optimize performance, ensure uptime, and minimize costs.
Our DevOps suite includes DevOps Core, NOC 24/7, FinOps, QA Automation, and DevSecOps to accelerate overall exponential growth.
As an AWS Advanced Tier Partner and Reseller, we focus on two key pillars: Professionalism by adhering to best practices and utilizing advanced technologies, and Customer Experience with responsiveness, availability, clear project management, and transparency to provide an exceptional experience for our clients.