Envoy Configuration for Kedify Proxy

At the core of kedify-http scaler is kedify-proxy, which forms a fleet of Envoy proxies. The fleet is configured over xDS control plane, implemented as part of the http-add-on interceptor component.

There are two parts of envoy configuration that support override of the default configuration, both are set as values in the kedify-agent helm chart:

1. cluster - chart, envoy options
2. route - chart, envoy options

Retry Configuration on Error

By default, kedify-proxy will not retry requests that fail with any error code and will return the error code to the client. With route configuration, you can enable retries for specific error codes. For example, to retry on 5xx errors, you can set the following in your kedify-agent values:

agent:
  kedifyProxy:
    route:
      retry_policy:
        retry_on: 5xx
        num_retries: 5
        retry_back_off:
          base_interval: 1s
          max_interval: 10s

This envoy config snippet means kedify-proxy will retry requests that fail with 5xx errors up to 5 times, with an exponential backoff starting at 1 second and capping at 10 seconds.