daemon memory leak
On this morning we get some Expired nodes warning. According to our records, 80 Smartnodes got this status.
Once we logged into the servers we detected a single daemon that ate 30G of RAM and "pushed" other daemons for the SWAP memory. Even in NvME devices (new generation SSDs) the SWAP is not 10% effective as RAM, that lead to high demand of CPU power which lead some daemons that did not get into the CPU to the expired status.
Restarting all the affected daemons fixed the issue, but it cost some time and during this process, 22 Smartnodes got the New Start Required Status. Since it was caused by a 3rd party software, we take no responsability on this event, there is no action or strategy that could be deployd by our estimated daemon cost to prevent this. Many solutions existe, but it would increase the service cost.
If you own any of the listed ips bellow, open your wallet, let it sync, and 15' after the sync is done, check if your node is down, select it and click Start Alias.
SMVCveUWPfvfxKApkmMzwxoFAMru6AwPwj |
107.175.138.162:9678 |
14d 22h 9m 38s |
SQBRGia5fQJMsLj3GmfvZrW7N2Zg9rYBoZ |
107.175.138.169:9678 |
78d 8h 10m 31s |
Sga6ZkiRgoXgdryA9ScXowmLxhDxSRqKzj |
107.175.138.170:9678 |
78d 8h 21m 10s |
SQeTCTDtbTHtpFmifdEuTfVuT9U1spayHF |
107.175.138.171:9678 |
78d 7h 55m 14s |
SUsye9sDdMhxHYYGq8Hvn5NTdb1Rtr1SF8 |
107.175.138.173:9678 |
78d 8h 17m 41s |
SfpnmR1yyZhgEHan9HsHz8ieQCu9TYwDma |
107.175.138.174:9678 |
78d 8h 19m 36s |
SMfYB4bmrKCBZmrMHotv6bMuzjEt8SX5ic |
107.175.138.176:9678 |
78d 8h 20m 15s |
Sh9Y7B6UhLr9SSEHMymZJGgEm1UGsUR4kG |
107.175.138.180:9678 |
44d 18h 15m 35s |
SUptuNBpBHngsPaziosuZVLxhYYWDYCgfw |
107.175.138.182:9678 |
44d 18h 18m 11s |
SQwF5Vcv83mm35vDfermxkFJcCcPhuZnCN |
107.175.138.184:9678 |
44d 18h 30m 50s |
SiHFVTMJjjLWRGPgpsVnoFMGo4X7qFfb4F |
107.175.138.185:9678 |
44d 18h 14m 39s |
Sj83uh9VgMnRAZMJqTpQ89Wn2FqEuyCydg |
107.175.138.186:9678 |
44d 18h 18m 31s |
SQ73RdWAnNmhZmU9kfvvYtmzxG6uXFgcvU |
107.175.138.192:9678 |
85d 59m 3s |
SYzFUb9wLAub48DKDitcniARYZRuNT147t |
107.175.138.195:9678 |
84d 9h 42s |
SiyDe9TgUfbS69gV4rXFX8ve8cgQrcGfhq |
107.175.138.210:9678 |
61d 10h 37m 14s |
STXpbKkYzzCtzjZfdS4be9ShJDyddMdgSK |
107.175.138.211:9678 |
61d 11h 23m 29s |
ShktUtVBFjQiawCciuhcXsCbZnMWDdbegE |
107.175.138.219:9678 |
84d 16h 32m 12s |
SN6Bq2DRhfAjdhftEFp4U4763fJt2xPSTZ |
107.175.138.221:9678 |
58d 9h 38m 47s |
SZh1svrx9HWKHkxnuWRHuB4j859WGiwD6R |
107.175.138.222:9678 |
58d 9h 29m 12s |
SjLnzQtUQPwJEtKRPFy6hNviWBwQw9p2mE |
107.175.138.224:9678 |
58d 9h 38m 47s |
ST1fcF3bPqVdm9SXEYGVEYUZGDRxcM5AA6 |
107.175.138.226:9678 |
58d 9h 31m 16s |
SRVuYZtmyXPVQvD2PmkiZ7mNuVqN74feJJ |
107.175.138.227:9678 |
58d 9h 32m 37s |
1