Automate

 View Only
  • 1.  Excel does not contain enough rows to download 25000 records

    Posted 09-29-2021 20:01
      |   view attached
    When extracting a single (KONP) table of 1.7 million lines of data it stops at 1,025,000 and get an error message. Not the typical data dump.

    Is there away around this for me to get the full 1.7 million lines

    I will go about a work around as I hear back.

    How are large data extracts used for migrations done if I would want to use Winshuttle to be the leading system to extract and load with?


    Thanks!

    ------------------------------
    Benjamin Kielas | Supervisor SAP Master Data
    Generac Power Systems, Inc. | (262) 510-6580
    ------------------------------


  • 2.  RE: Excel does not contain enough rows to download 25000 records

    Posted 09-30-2021 02:13
    Hi Benjamin,

    In my opinion you have 2 options when using Winshuttle for this:
    - download in parts. Then you to upload also in parts.
    - download to Access instead of to Excel. That option is also available, we used it in the past for migration.

    kind regards

    ------------------------------
    Jan van Asseldonk | Consultant
    CTAC | +31629078169
    ------------------------------



  • 3.  RE: Excel does not contain enough rows to download 25000 records

    Posted 09-30-2021 08:29
    Hi Benjamin,

    For data sets that large, it is best to export into SQL. Excel or SharePoint will both error due to their limittions. Access might be too much due to the amount of work that would need to go into it. The other option you could try is a text file. But in my learnings SQL has been the best option. Studio will create the table for you, so it's not soemthing you'd need to create ahead of time. 

    I hope this helps

    ------------------------------
    Vanessa Kutasi | Application Analyst II
    IDEXX | New England WUG Leader
    ------------------------------



  • 4.  RE: Excel does not contain enough rows to download 25000 records

    Employee
    Posted 09-30-2021 08:35
    Hi Benjamin

    I'll jump in - Excel has a 1M row limit:  https://support.microsoft.com/en-us/office/excel-specifications-and-limits-1672b34d-7043-467e-8e27-269d656771c3

    Other options:

    • You can output to Access, which Jan recommended.
    • If you have Studio Manger, Evolve or Foundation, you can direct the output to a SQL table.

    Best Regards,
    Sigrid

    ------------------------------
    Sigrid Kok
    PSE | Winshuttle NA
    ------------------------------



  • 5.  RE: Excel does not contain enough rows to download 25000 records

    Posted 09-30-2021 08:44
    Thank you for all the quick feedback. I will look into these options moving forward.

    ------------------------------
    Benjamin Kielas | Supervisor SAP Master Data
    Generac Power Systems, Inc. | (262) 510-6580
    ------------------------------