Use case

Efficient Microservices Scaling with KEDA

About the Customer

Illuminate Tech is a leading provider of advanced data analytics solutions. They support organizations in harnessing the power of data to drive better decision-making through innovative tools and platforms. Illuminate Tech’s platform demands high scalability and flexibility to manage its microservices infrastructure efficiently.

Customer Challenge

Illuminate Tech required an autoscaling solution for its microservices running on Kubernetes. The challenge was to implement a scalable and cost-efficient system that could dynamically adjust the number of active instances based on BullMQ metrics stored in Redis. The absence of such a solution resulted in resource over-provisioning and unnecessary costs.

Solution

IAMOPS implemented KEDA (Kubernetes-based Event Driven Autoscaler) to manage the dynamic scaling of Illuminate Tech’s microservices. KEDA’s event-driven architecture allowed for scaling based on custom metrics from Redis, providing fine-tuned control over microservices scaling.

The implementation involved several steps:

  • Deploying KEDA using Helm charts in the Kubernetes cluster.
  • Defining the ScaledObject CRD to manage scaling rules based on BullMQ metrics.
  • Configuring Redis as an event source for KEDA to trigger autoscaling events.
  • Integrating these configurations with the custom Helm chart for seamless deployment and management of the microservices.

The following diagram illustrates the scaling mechanism implemented using KEDA:

Semantic Release Workflow

Results & Benefits

The implementation of KEDA delivered several key benefits:

  • Improved Resource Utilization: By scaling microservices based on queue metrics, resources were only utilized when necessary, leading to significant cost savings.
  • Enhanced Performance: The autoscaling mechanism allowed for quick responses to workload spikes, ensuring minimal delay in scaling.
  • Operational Efficiency: The automation reduced manual intervention, enabling the DevOps team to focus on other high-priority tasks.
  • Future Scalability: The KEDA integration set a scalable framework for future microservices expansions, enhancing overall infrastructure scalability.

About IAMOPS

IAMOPS is a full DevOps suite company that supports technology companies to achieve intense production readiness.

Our mission is to ensure that our clients’ infrastructure and CI/CD pipelines are scalable, mitigate failure points, optimize performance, ensure uptime, and minimize costs.

Our DevOps suite includes DevOps Core, NOC 24/7, FinOps, QA Automation, and DevSecOps to accelerate overall exponential growth.

As an AWS Advanced Tier Partner and Reseller, we focus on two key pillars: Professionalism by adhering to best practices and utilizing advanced technologies, and Customer Experience with responsiveness, availability, clear project management, and transparency to provide an exceptional experience for our clients.

Looking for a dedicated DevOps team?

Book a Free Call