LAE

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: Feridun

Hello everyone,

Below, you may find the error we're facing. What we did was increasing the buffer size of the sort node. Is there another related setting/property to set? By the way, when the size is set to 1073746824, it works. and the Virtual machines available RAM is 16GB.

Thanks in advance.

Error while starting execution of node 'Sort'
Error executing node: Process exited before ENDIO message received.
2013-05-13 15:47:12.000; WARN: ...exception seen
id: 0 chain: 0 group: 0
cppDetail: context: Salmon::NED::Sort::SortNodeControl::getBufferSizeF romProperties() build/linux-x86-64/release/code/source/brain/node/nodeSort/SortNodeControl.cpp@349

2013-05-13 15:47:12.000; WARN: ...exception seen
id: 0 chain: 0 group: 0
cppDetail: context: Salmon::NED::Sort::SortNodeControl::getSettingsFro mProperties() build/linux-x86-64/release/code/source/brain/node/nodeSort/SortNodeControl.cpp@289

2013-05-13 15:47:12.000; WARN: ...exception seen
id: 0 chain: 0 group: 0
cppDetail: context: Salmon::NED::NodeControl::initialize() build/linux-x86-64/release/code/source/brain/node/NodeControl.cpp@315

2013-05-13 15:47:12.000; ERROR: ERROR reading settings:
ERROR Interpreting property ls.brain.node.sort.maxBufferSize as integer, value is: 2147483648
id: 0 chain: 0 group: 0
cppDetail: context: Salmon::NED::NodeMain::errorMsg() build/linux-x86-64/release/code/source/brain/node/NodeMain.cpp@28

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: rboccuzzi

So the reason this is failing, the value given is one larger than the largest size of a 32 bit signed int, as you are probably aware. As an aside, if you are using windows, this is a 32-bit app; however, it appears you are using Linux from the log messages. I have logged a request (ISSUE 4907) to increase this to a long, which would help. I have also noted the error message could be improved to show that it is just too large a number, which would probably be easier to understand as well, I think.

Cheers
Rich

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: Feridun

Hi Rich,

Thank you for your reply. It would also be great to specify it in MBs maybe.

Regards,

Feridun

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: rboccuzzi

Yep, good idea, I updated the issue with that request as well.

Cheers
Rich

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: DanRosenblatt

This has been addressed in LAE version 4.6.1.2.

The sort node now supports a maxBufferSize specification larger than a 32-bit signed integer (2^31-1). The new maximum is 2^64. However, the sort buffer can never be larger than 2^31-1 rows no matter how much memory is available.

Additionally, the maxBufferSize property now supports unit suffixes e.g. 1234m for 1234 megabytes.

The complete list of suffixes is:

b = 1
B = 1
k = 10^3
K = 2^10
m = 10^6
M = 2^20
g = 10^9
G = 2^30
t = 10^12
T = 2^40
p = 10^15
P = 2^50
e = 10^18
E = 2^60

An error will occur if any size using any unit exceeds the maximum 2^64 bytes e.g. 1000E (one thousand exabytes) will cause an error.