Useful commands

Here we will collect the most useful and frequent commands for Hosts

General information

Commands often require inserting your IP, key, or some other information. Be careful.

Much of the information is taken from this Telegram channel: A secret to the whole worldarrow-up-right

Thank you!

Checking correct key setup

Node setup

Delisting mlnode

cd /root/gonka/deploy/join docker compose -f docker-compose.yml -f docker-compose.mlnode.yml stop inference mlnode-308

Starting Docker Compose

Node flags

Draft:

--enable-expert-parallel, --kv-cache-dtype fp8, --gpu-memory-utilization 0.94

For other GPU models there may be no flags/arguments beyond the standard --tensor-parallel-size "4"; except for B200, where custom flags are often used and there is no single registration option β€” it depends on the host's capabilities.

Other

Checking the node list on the Network Node

Check if your Validator is registered

*Insert your wallet address

  1. Outputs some unsafe key:

./inferenced keys export KEY-NAME --keyring-backend file --unarmored-hex --unsafe

Example:

./inferenced keys export gonka-account-key --keyring-backend file --unarmored-hex --unsafe

Last updated