Buffer Error while using OpenCore

[Morphyum]

OpenCore version: 1.5.12.64
self hosted
Error message:
collectionname workitems page: /ui/workitem idx: 0 res: 100 skip: 0 query: {} token: eyJhbGciOi
core-web version 0.1.2.23 git commit 5fb9c6d opencore version 1.5.12.64
11:22:27.965 [DatabaseConnection ][query] Query gave 1 results using 771 Bytes memory
11:22:27.967 [DatabaseConnection ][query] Query gave 1 results using 665 Bytes memory
11:22:27.970 [DatabaseConnection ][query] Query gave 1 results using 771 Bytes memory
11:22:27.971 [DBHelper ][WorkitemQueueUpdate] Clear workitem queue cache : 68e8a8e3b9fafb87a2067fd0
11:22:27.974 [DBHelper ][WorkitemQueueUpdate] Clear workitem queue cache : 68e8a8e3b9fafb87a2067fd0
11:22:27.975 [DatabaseConnection ][UpdateOne] updated 2060772736-120
11:22:27.975 [DBHelper ][WorkitemQueueUpdate] Clear workitem queue cache : 68e8a8e3b9fafb87a2067fd0
11:22:27.979 [DatabaseConnection ][query] Query gave 1 results using 665 Bytes memory
11:22:27.981 [DatabaseConnection ][query] Query gave 1 results using 724 Bytes memory
11:22:27.984 [DatabaseConnection ][UpdateMany] updated 1 items
11:22:27.985 [DBHelper ][WorkitemQueueUpdate] Clear workitem queue cache : 68e8a8e3b9fafb87a2067fd0
11:22:28.24 [DatabaseConnection ][query] Query gave 1 results using 523 Bytes memory
11:22:28.25 [LoginProvider ][getconfig] Return configuration settings
[server][INF] Client connected, client count 32
11:22:28.353 [message ][Signin] ``marvin.schwabe`` successfully signed in
11:22:28.358 [DatabaseConnection ][InsertOne] inserted Marvin Schwabe
11:22:28.358 [message ][Signin] ``marvin.schwabe`` signed in using jwtsignin gc9v89km5/unknown
11:22:28.358 [DBHelper ][UserRoleUpdate] Remove user from cache : 6819d240ddbb1112527e867a
11:22:28.393 [DBHelper ][FindByIdWrap] Add user to cache : 6819d240ddbb1112527e867a
11:22:28.396 [DatabaseConnection ][query] Query gave 1 results using 1020 Bytes memory
11:22:28.397 [DBHelper ][DecorateWithRolesAllRolesWrap] Add all roles
11:22:28.404 [DatabaseConnection ][query] Query gave 30 results using 5.97 KB memory
11:22:28.409 [DatabaseConnection ][query] Query gave 1 results using 1020 Bytes memory
11:22:28.454 [DatabaseConnection ][query] Query gave 1 results using 7.38 KB memory
11:22:29.719 [DatabaseConnection ][query] Query gave 100 results using 222.38 KB memory
11:22:29.826 [DatabaseConnection ][query] Query gave 19 results using 13.5 KB memory
11:22:30.653 [DatabaseConnection ][query] Query gave 1 results using 7.38 KB memory
11:22:31.361 [DatabaseConnection ][query] Query gave 100 results using 23.03 MB memory
11:22:31.922 [DatabaseConnection ][query] Query gave 1 results using 7.38 KB memory
[client][WAR] Buffer size increased to 15.00 MB
RangeError: offset is out of bounds
at Uint8Array.set ()
at messageParser.write (file:///app/dist/public/server/chunks/auth.svelte-vF_5z-YL.js:3642:21)
at ws.onmessage (file:///app/dist/public/server/chunks/auth.svelte-vF_5z-YL.js:3822:20)
at callListener (file:///app/dist/public/server/chunks/module-CcjLScfg.js:10733:15)
at WebSocket.onMessage (file:///app/dist/public/server/chunks/module-CcjLScfg.js:10652:10)
at WebSocket.emit (node:events:524:28)
at WebSocket.emit (node:domain:489:12)
at Receiver.receiverOnMessage (file:///app/dist/public/server/chunks/module-CcjLScfg.js:12173:21)
at Receiver.emit (node:events:524:28)
at Receiver.emit (node:domain:489:12)
RangeError: offset is out of bounds
at Uint8Array.set ()
at messageParser.write (file:///app/dist/public/server/chunks/auth.svelte-vF_5z-YL.js:3642:21)
at ws.onmessage (file:///app/dist/public/server/chunks/auth.svelte-vF_5z-YL.js:3822:20)
at callListener (file:///app/dist/public/server/chunks/module-CcjLScfg.js:10733:15)
at WebSocket.onMessage (file:///app/dist/public/server/chunks/module-CcjLScfg.js:10652:10)
at WebSocket.emit (node:events:524:28)
at WebSocket.emit (node:domain:489:12)
at Receiver.receiverOnMessage (file:///app/dist/public/server/chunks/module-CcjLScfg.js:12173:21)
at Receiver.emit (node:events:524:28)
at Receiver.emit (node:domain:489:12)

Hi Allan,

we just encountered the above-mentioned problem, which killed the entire frontend for all users until the container was restarted. Certain users triggered this error when navigating the page. The workitem tab in particular triggered the error more frequently.

The solution to the whole problem was ultimately to reset the filters and settings for these users. From memory, the only thing that could trigger the above error message would be the fact that the user had 100 items per page displayed and possibly some additional fields.

I’m not entirely sure what exactly caused this error, but it would still be good if, in this case, the entire frontend didn’t crash and the user was shown an error message instead.

Best regards

[Allan_Zimmermann]

The problem is not the fields. The web interface gets all data, no matter what fields you select. The problem is how much data is used for the query (so all documents combined).

We noticed this pretty quickly after implementing the new interface, and a “quick workaround” was added to prevent paging from allowing more than 100 items.

You are not supposed to have more than 100 kilobytes per document in MongoDB, but you CAN have up to 2-megabyte JSON documents. I regret storing XAML for OpenRPA in documents directly and not using GridFS, as I could see that the OpenRPA collection could cause issues in certain cases.
We definitely need to make a more permanent solution since there could be cases where you store too much data per document (like OpenRPA).