Back to Articles

VUE server supports 1:1 and N:1 redundancy to achieve high availability using redundancy clusters (RC). A redundancy cluster is a group of VUE application servers in which one or more VUE servers performs the active role while only one server performs in a standby role. When the standby VUE application server detects a failed active server, it takes over the failed active VUE server and achieves high availability.

VUE supports two types of redundancy clusters:
  • N:1 redundancy cluster (hot_cold): In an N:1 RC, up to 10 VUE servers can perform in the active role and a single VUE server performs as a standby server. Because an N:1 cluster uses a single standby server to backup N active servers it maintains configuration synchronization with all the N servers. The standby server does not actively process video until there is a failover where it assumes the configuration of the failed active server at that time. This is a hot_cold redundancy cluster
    N:1 High-Availability cluster
  • 1:1 redundancy cluster (hot_hot): In a 1:1 RC, a pair of VUE application servers forms a cluster, in which, one VUE server performs in the active role while the other server is in a standby role. A 1:1 RC is a hot_hot cluster because there is only one active server to be backed up by the standby server, the standby can assume the active's configuration and be processing video, but not transmitting anything on its outputs.

The standby server stores the configurations (and ACCP state) of up to ten active servers. Changes to the configuration of any active servers are automatically synchronized with the standby server within one second

In a 1:1 redundancy cluster, the active server receives and transmit video/data streams while the standby server only receives video/data streams (all output TS on the standby server is dropped by the server through the use of IP tables). The standby server continuously listens to all the active servers making it a hot_hot cluster.

In an N:1 redundancy cluster, the standby server does not actively process video until there is a failover where it assumes the configuration of the failed active server at that time. The Auto Failback feature in an N:1 redundancy cluster enables the recovered Initial Active Server to automatically revert back to the Initial Active Server from the Standby Server. This will free-up the Standby server as soon as possible making it again available for the cluster. You can set the auto failback delay time period for the recovered initial active role to revert to the initial active role freeing the standby server.

In a 1:1 cluster, there is only one active server to be backed up by the standby server. Hence, the standby assumes the active server's configuration and processes video, but does not transmit anything on its outputs.

In an N:1 HA redundancy cluster, a recovered initially active server will assess its own health and the health of the current active standby server before resuming the active role. This enhancement allows the system to stay on a healthy standby server if needed, preventing unnecessary service interruptions.

The initial standby server must have equal or more number of cores, equal or more memory, and equal or more interfaces than the initial active servers. VUE performs compatibility checks to ensure the initial standby has equal or more resources than the initial active server. VUE informs you if the initial standby server resources are insufficient to backup every initial active server within the cluster.

The VUE servers within an RC share health status information by using Heartbeat (HB) protocol. The HB protocol provides information about each node’s health status, status of its NICs, current state (for example, failed or unavailable), ID, readiness to assume active role if an initially active server, readiness to assume standby role if it is was assigned as the initial standby server. Heartbeats are exchanged every 100 ms. Failure to receive a HB signal within the configured heartbeat interval (default is 2000 ms) period is considered as a failure of the active server causing the standby server to take over. This interval is configurable from 300 ms to 5000 ms. CommScope recommends to configure two HB interfaces on each server to prevent unnecessary failover due to loss of network connectivity (for example, switch port failure, switch power loss). As long as a HB is received from one of the interfaces within the configured HB window, a failover will not be triggered unless the HB protocol indicates an unhealthy condition exists on the active server (for example, failed interface).

The management IP interface is typically the primary heartbeat interface. Since this interface always has a static IP assigned and is accessible through the VPS servers, the management interface is recommended to be the primary HB interface. A second HB interface can be set up on any other interface configured with either a static IP or a VIP (provided the 2 servers can communicate with each other over this interface). Heartbeat signals exchange the following information of the two servers:
  • Ingress video bandwidth (applicable for 1:1 RC)
  • Link status of all interfaces
  • Current role of the server (active or standby)
  • Health of the server (OK, Error, and so on.)

The initial standby server supports up to 2 receive HB UDP stream and 2 transmit HB UDP streams from each initial active server.

Each VUE Application Server contains an agent called the VUE Application Monitoring Service (VAMS) which is responsible for monitoring the particular node and fetching configuration changes made by the VUE controller. VAMS also works in conjunction with a distributed cache (REDIS) to maintain configuration synchronization between active server(s) and the standby server when HA is enabled.

You can choose multiple initial active servers during the creation of the redundancy cluster by choosing the Hot_Cold RC type on the Element Manager (EM). The initial active servers maintain all the transport streams, mappings, Auxiliary Core Control Plane (ACCP), and SDV configuration. Any configuration change in the initial active server is synced with the standby server automatically. The initial active servers can have streams and mappings configured prior to the creation of the RC. The configured streams and mappings on the initial active server will be synced to the initial standby server when the RC is created. You cannot configure any streams or mappings on the initial standby server.

To facilitate the configuration and failover, you must configure the input/output interfaces with VIPs. This allows the same transport stream or mappings to be configured on both servers. VUE utilizes IP tables to block all output (ARPs, ping, data Tx) on the standby server. This means that only the management interface can have a static IP assigned. All other interfaces used by the VUE servers utilizes a VIP.

You can add new servers during the creation of an RC.

You can delete or modify a server or a redundancy cluster through the EM based on your system requirements.

You can manually initiate a failover for scheduled maintenance, such as a software upgrade.

When HB communications are re-established, and assuming both servers are healthy at that time, the server that was the first server to become initially active (state retained by the system and shared using the HB protocol) as part of the RC remains as an active server, and the other server assumes a standby role. Alternatively, if one of the active servers is observed to be in a degraded state after HB communications is re-established, the healthy server remains active, and the unhealthy server assumes the standby role.

Geo-redundancy support

Geo-redundancy support in a 1:1 cluster can be helpful when servers reside in different geographic locations. You can configure input mappings to be received from different sources when 2 servers are in a redundancy cluster. It allows you to setup input mappings and identify a secondary set of input parameters to be used by the initial standby server. You can configure a different UDP port, Multicast IP, and Source IP to use for receiving inputs on the initial standby server. This allows each server in an RC to receive the same content but through different input streams. For each mapping (program, PID, pass through, or OOBM), you can configure a second set of input parameters (UDP port, Multicast IP, and source IP). You can set 1 or all 3 parameters to be used. When not set (0 or 0.0.0.0), then the primary input parameters are used in all cases. When you configure secondary inputs for mappings those will be displayed on the mappings screen when the you select to display the initial standby server.

NOTE: Geo-redundancy support is applicable only for 1:1 RC.

HA failover triggers

An HA failover is triggered when one of the following error conditions is detected:

  • Loss of link of a configured interface on the initial active server.
  • Loss of heartbeats for longer than the configured heartbeat interval (default is 2000 ms). Note that with two configured HB interfaces, HBs from both interfaces must be lost for this period to trigger failover.
  • Active server initiates a failover when the health state of the active server is in an error state while the standby server is in an OK state.
  • When the active server’s input rate drops below the threshold adjusted standby server’s input rate (threshold percentage * measured standby’s input rate).
  • When the active server ingress rate drops below the user-defined level as compared to the ingress rate of the standby server.

For more information, see Configure a redundancy cluster.