LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  DB Store Performance with MySQL

    Employee
    Posted 11-06-2013 08:19

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dstacey

    Hello,

    I've been using DB Store node to successfully write (via odbc interface) to a local instance of a MySQL database. However, when I migrate the database to a remote server the performance degrades - I am only able to write approx 1 field every 5 seconds.

    The problem is probably with the configuration of the MySQL server itself but before I dive too deeply into its configuration I wondered if anyone had any experience of this and some tips on any Lavastorm side tuning that I need to do.

    thanks,
    Dave


  • 2.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-10-2013 18:51

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: xathras

    Dave, what is the load method you're using. Insert or Optimized? If Optimized what is the rate of the commit frequency?


  • 3.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-11-2013 04:04

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dstacey

    Hi,

    I've tried both insert and optomized. For a 2000 record table this is an example of the results I am getting:

    Optomized - Commit Frequency = 1000 : time to load database = 304 seconds
    Optomized - Commit Frequency = 100 : time to load database = 318 seconds
    Insert - Commit Frequency = 1000: time to load database = 303 seconds

    I now think it's definitely a problem with my Lavastorm configuration (rather than connection or MySQL db config) as I am able to load a table containing the same data via a direct MySQL query in just 4 seconds.

    I am also able to load the table within a LS DB Execute node containing the same MySQL query in an sqlNonSelect command in about 8 seconds.

    So I am very stuck as to why I am getting such poor performance with the DB Store node.

    thanks,
    Dave


  • 4.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-11-2013 20:39

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: xathras

    Have you tried via JDBC Store and what is the timings?


  • 5.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-12-2013 08:58

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dstacey

    The timings almost double when I try the JDBC Store (commit frequency 1000, optomised)


  • 6.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-12-2013 20:24

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: xathras

    Hi Dave,

    We have a Enterprise Edition Server running on a VM with RHEL. I connected to one of our MySQL DB's using LAE 4.6.0 and was able to insert records at lightening speeds in comparison to yours.
    I would recommend you open a ticket with support

    Both JDBC and DB Store. DB Store was a little faster.

    Wayne



  • 7.  RE: DB Store Performance with MySQL

    Employee
    Posted 11-13-2013 01:21

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dstacey

    Hi Wayne,

    Thanks for all of your help - much appreciated.

    I have opened a ticket with support and hopefully we will get to the bottom of it soon! I will post an update if I find a solution.

    Dave