Heavy CPU/disk usage after BitMEX disconnect

Post Reply
konsix
Posts: 1
Joined: Mon Jan 13, 2020 3:55 pm

Heavy CPU/disk usage after BitMEX disconnect

Post by konsix » Mon Jan 13, 2020 4:05 pm

Code: Select all

20200113 10:34:17.912(UTC) INFO: Platform info:MEX-7.0.0 build:83
20200113 11:31:55.634(UTC) INFO: Process memory usage: PrivateBytes=708399104
20200113 12:00:05.283(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: last message UTC=2020-01-13T11:59:59.566Z
20200113 12:00:05.286(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: connection possibly lost UTC=2020-01-13T12:00:05.289Z
20200113 12:00:05.313(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket onFrame: PONG
20200113 12:31:55.634(UTC) INFO: Process memory usage: PrivateBytes=760074240
20200113 12:59:20.997(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: last message UTC=2020-01-13T12:59:13.604Z
20200113 12:59:20.998(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: connection possibly lost UTC=2020-01-13T12:59:21.001Z
20200113 12:59:26.000(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: last message UTC=2020-01-13T12:59:13.604Z
20200113 12:59:26.001(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: connection lost UTC=2020-01-13T12:59:26.004Z
20200113 12:59:26.001(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket launchPingTimer: pingTimer closes connection
20200113 12:59:26.004(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket: CLOSED WITH STATUS 1006 FOR Harsh disconnect REASON
20200113 12:59:26.005(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSockeT close(): socket interrupted
20200113 12:59:26.012(UTC) WARN: Connection lost, stopping history recoding for XBTUSD@MEX
20200113 12:59:26.034(UTC) WARN: Underlying connection lost(BitMEX):NO_INTERNET, Connection lost
20200113 12:59:26.198(UTC) INFO: [bitmex-v.0.7.0.3-alpha] [bitmex v.0.7.0.3-alpha] BmConnector wsConnect websocket starting...
20200113 12:59:26.198(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector wsConnect websocket being created...
20200113 12:59:26.198(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector wsConnect client starting...
20200113 12:59:26.200(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector wsConnect websocket connecting...
20200113 12:59:26.339(UTC) INFO: [bitmex-v.0.7.0.3-alpha] Starting panel server...
20200113 12:59:26.340(UTC) INFO: [bitmex-v.0.7.0.3-alpha] Panel server started
20200113 12:59:26.340(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector wsConnect websocket webSocketStartingLatch is down
20200113 12:59:26.341(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector subscribe: XBTUSD
20200113 12:59:26.341(UTC) WARN: Connection restored, resuming history recoding for XBTUSD@MEX
20200113 12:59:26.341(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector subscribe: set true
20200113 12:59:26.342(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector wsConnect Send websocket message
20200113 12:59:26.342(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.342(UTC) INFO: Recorder layer created, true false
20200113 12:59:26.342(UTC) INFO: [bitmex-v.0.7.0.3-alpha] ClientSocket sendMessage: {"op":"subscribe","args":["orderBookL2:XBTUSD","trade:XBTUSD"]}
20200113 12:59:26.342(UTC) INFO: switchRecorderToDataFile E:\Bookmap\Data library\XBTUSD%0000AUTO%0000AUTO@EXT%003Ac6vo4t9%00000.5%00001.0%00001578920366341581100%00009223372036854775807%00000.bml
20200113 12:59:26.342(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.343(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.343(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.343(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.343(UTC) INFO: [bitmex-v.0.7.0.3-alpha] BmConnector launchSnapshotTimer 1 for XBTUSD: 2020-01-13T12:59:26.347Z
20200113 12:59:26.343(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.344(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.344(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.344(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.344(UTC) WARN: Underlying connection restored(BitMEX)
20200113 12:59:26.344(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.345(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.345(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.346(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.346(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.346(UTC) INFO: onLoginSuccessful, firstRecordingStarted = false
20200113 12:59:26.347(UTC) INFO: changeFeedFile
20200113 12:59:26.346(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.347(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.347(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.347(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.348(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.349(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.350(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.351(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.352(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.352(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.352(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.352(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.353(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.353(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.353(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.353(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.354(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server

...

20200113 12:59:26.376(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.376(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.377(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.377(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.377(UTC) INFO: [bitmex-v.0.7.0.3-alpha] JsonParser parser: service message {"success":true,"subscribe":"orderBookL2:XBTUSD","request":{"op":"subscribe","args":["orderBookL2:XBTUSD","trade:XBTUSD"]}}
20200113 12:59:26.377(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.377(UTC) INFO: [bitmex-v.0.7.0.3-alpha] JsonParser parser: service message {"success":true,"subscribe":"trade:XBTUSD","request":{"op":"subscribe","args":["orderBookL2:XBTUSD","trade:XBTUSD"]}}
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.378(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.379(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] JsonParser preprocessMessage: partial acquired for  trade
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  closing server
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed
20200113 12:59:26.380(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: client socket closed
20200113 12:59:26.381(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server: server socket closed
20200113 12:59:26.381(UTC) INFO: [bitmex-v.0.7.0.3-alpha] PanelServerHelper :  server closed

...
 
If the BitMEX connection is lost and re-connection happens, there is huge CPU usage and a lot of log writing. You can easily get a 8 GB log file in 8 hours.

While this is happening, this dialog will be up, even if the BitMEX data is actually updating behind it:

Image
 
Top
Andry API support
Posts: 548
Joined: Mon Jul 09, 2018 11:18 am
Has thanked: 25 times
Been thanked: 85 times

Re: Heavy CPU/disk usage after BitMEX disconnect

Post by Andry API support » Mon Jan 13, 2020 6:05 pm

Please update the adapter to v.0.7.0.4.1.
It is fixed for the latest version.
Top
Post Reply

Return to “BitMEX”