We have updated Flexmonster Software License Agreement, effective as of September 30, 2024. Learn more about what’s changed.

176 MB Compressed CSV not loading, Total File Size of 1.3 GB, 800,000 rows

Answered
Shripal Dalal asked on November 18, 2021

Hi,
 
I have a file size of 176 MB (gzip compressed) total file size 1.3 GB CSV. It stops loading after 524233 KB. Please find screen shot attached.
 
We can load the CSV directly on your site without any problem. That is by connecting to Local CSV data. But when it comes to downloading and decompressing the file it does not work.
 
Could you please suggest a fix ?

Attachments:
flexmonster.png

6 answers

Public
Shripal Dalal November 18, 2021

PS it loads if you leave it on for sometime, but only 350000 rows are loaded instead of the 800000. Thanks.

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster November 19, 2021

Hello, Shripal,
 
Thank you for reaching out to us.
 
We want to explain that Flexmonster is a client-side component, it relies on resources available to the browser, which affects the loading time and the maximum size of the data that can be handled. Therefore, the machine’s RAM determines how much data can be loaded at once. Some machines may just not handle loading a large dataset into the browser at once.
Our team suggests using the Flexmonster Data Server - a more efficient approach for working with large datasets. It reduces browser memory usage by loading only the required part of the data for the report and processing the calculations on the server side. Feel free to check the detailed guide in our documentation: https://www.flexmonster.com/doc/getting-started-with-data-server/
 
Please let us know if this approach works for you. Feel free to contact us if other questions arise.
 
Kind regards,
Nadia

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster November 26, 2021

Hello, Shripal,
 
Hope you are doing well.
 
We were wondering if the suggested solution helped you. We will be glad to hear your feedback.
 
Kind regards,
Nadia

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster December 13, 2021

Hello,
 
Hope you are doing well.
 
Just checking in to ask if the solution meets your needs. 
 
Looking forward to your feedback.
 
Kind regards,
Nadia

Public
Shripal Dalal December 13, 2021

Hi Nadia,
It works in Mozilla Firefox. Also if you download the entire file and connect to it as a local CSV it works.
Also we have a lot of columns so maybe I will try to reduce those to reduce file size.

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster December 13, 2021

Hello,
 
Thank you for your feedback. 
 
Feel free to contact us if other questions arise.
 
Kind regards,
Nadia

Please login or Register to Submit Answer