Skip to content

SKALE Node Swap Limit Fix

Introduction

This guide provides instructions for SKALE validators to fix swap limit issues on their nodes. We need to enable swap limiting capability so sChain containers can use swap properly.

Background

Swap memory is limited by default if memory for the container is limited. For each sChain container, 2.6GB of RAM is allocated on the machine, which means an additional 2.6GB will be allocated for swap. For more details, refer to the Docker documentation on resource constraints.

Checking Current Setup (Optional)

You can check the current memory allocation for your sChain containers (if your node has sChains) using the following command:

Terminal window
docker inspect skale_schain_[SCHAIN-NAME] | grep Memory

A correct setup should look similar to this:

"Memory": 2678032302,
"MemoryReservation": 0,
"MemorySwap": 5356064604,
"MemorySwappiness": null,

MemorySwap should be x2 of Memory value.

Identifying the Issue

The issue occurs when the swap limit capability is disabled in the kernel. To check if this is the case, run:

Terminal window
docker info

If you see the following line at the end of the output, it means the swap limiting capability is disabled:

WARNING: No swap limit support

Fixing the Swap Limit Issue

Follow these steps to enable swap limiting capability:

  1. Log into the node as a user that you used to setup the node (user should have sudo privileges).

  2. Make a backup of your node and move backup archive to another machine:

    Terminal window
    skale node backup [BACKUP_FOLDER_PATH] [ENV_FILE]

    Check out node-cli backup docs for more details.

  3. Turn off your SKALE Node:

    Terminal window
    skale node turn-off

    Wait for the node to turn off gracefully.

  4. Edit the /etc/default/grub file. Add or edit the GRUB_CMDLINE_LINUX line to include the following key-value pairs:

    GRUB_CMDLINE_LINUX="cgroup_enable=memory swapaccount=1"
  5. Update GRUB:

    Terminal window
    sudo update-grub
  6. Reboot the machine:

    Terminal window
    sudo reboot
  7. After the machine has rebooted, turn your SKALE Node back on:

    Terminal window
    skale node turn-on [ENV_FILEPATH]

    Replace [ENV_FILEPATH] with the path to your environment file (the same you used for node updates).

    For more details on this process, you can refer to this Unix Stack Exchange thread.

  8. After the node is turned on, check if the swap limit is enabled:

    Terminal window
    docker info

    No warning should be displayed.