LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
Back to discussions
Expand all | Collapse all

server threads and shedules graphs

  • 1.  server threads and shedules graphs

    Employee
    Posted 10-02-2015 08:30

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dhrobertson

    Hi guys,

    I need to get a handle on how the threads work on the server when running graphs. I have set our server to use 20 threads currently. My assumption based on this is that if I have 5 scheduled graphs kicking off at exactly the same and each graph has hash split nodes splitting the data processing on each graph into 20 separate streams. so we have roughly 100 nodes between the 5 graphs. My understanding is that because I have specified 20 threads as the setting on the server, that at any given time there will only ever be 20 threads running and not 100? ie. the 20 threads is used across all scheduled runs and not 20 threads per graph?

    the reason I ask is that I notice sometimes that the number of python.exe tasks running on the server can be more that 20 which to me doesnt make sense.

    I ask this as I am doing a lot of SAP data extractions at a client and I have 13 graphs running concurrently with a ton of SAP nodes pulling data due to the length of time it takes to pull anything back from SAP. in order to complete in the time the client wants, I need concurrent pulls from the table. it is clearly creating a lot of sessions (dialog sessions) on the SAP server and the SAP team has freaked out and wants us to shut the whole thing down. I need to get my ducks in a row in understanding that the maximum number of sessions at any given time hitting SAP will be the same as the number of threads I have specified in the server config file, ie. 20 or could it be more?

    thanks

    douglas