Data360 Analyze

 View Only
Back to discussions
Expand all | Collapse all

Reading/writing parquet files

  • 1.  Reading/writing parquet files

    Posted 03-30-2023 09:45

    What options do we have for reading and writing parquet files? I have found a custom solution in an older thread of these message boards that used Java to process parquet files; I have successfully used this method with small parquet files however it seems to have problems with large datasets.

    I'm wondering what alternatives there are that might be more efficient, is there any other solutions through R, Spark, Python? 

    Thanks, 

    Alex



    ------------------------------
    Alex Day
    Knowledge Community Shared Account
    ------------------------------