We have updated Flexmonster Software License Agreement, effective as of September 30, 2024. Learn more about what’s changed.

How to override dataset size limit?

Answered
Viktor Ürmös asked on November 27, 2020

Hi Flexmonster team!
We are wondering, is there any way to override the built in treshold?
 
As we know from you (questions/answers in your forum), Flexmonster is not measuring the dataset.
"We would like to mention that Flexmonster is not measuring the dataset. The component will be loading the data as long as there are enough resources of the browser and RAM."
 
Our scenario includes the expandAll function, which crashes in Classic layout form (Dataset is too large), if there are more than 3 columns (this depends of the rows data as well of course). We understand, that this operation considerd as a heavy operation, but measuring the RAM and CPU meanwhile running the expandAll function we identifed minimal changes:
CPU usage increases to 30% for 8 seconds(RAM and CPU).
RAM usage increases with a few megabytes.
 
Our customers are working with huge datasets, but cant use Flexmonster properly, because the operations are being stopped in the middle of the calculation. We are willing to push the browser's boundaries, and accept, if the operation will crash. How can we experiment with this?
Thank you in advance,
Ürmös Viktor

8 answers

Public
Milena Pechura Milena Pechura Flexmonster November 30, 2020

Hello, Viktor!
 
Thank you for the detailed description of your case.
 
Could you please let us know what data source you use?
This will help us to provide you with the most suitable solution.
 
Looking forward to hearing from you.
 
Best regards,
Milena

Public
Viktor Ürmös December 2, 2020

Hi Milena!
 
Yes, I am uploaded an example json. You can download from the following link:
 
https://dynflowjnr-my.sharepoint.com/:u:/g/personal/viktor_urmos_dynflow_hu/EZPviES3moZEmbA8xR-cjIoB6TQhmj4jmkPy9C3WXELsew?e=5fJj2T
password: ********
 
Best regards,
Ürmös Viktor

Public
Milena Pechura Milena Pechura Flexmonster December 4, 2020

Hi, Viktor,
 
Thank you for providing the report.
 
Our team is currently working on your case.
We will make sure to reach out to you shortly.
 
Kind regards,
Milena

Public
Milena Pechura Milena Pechura Flexmonster December 7, 2020

Hello, Viktor,
 
We have carefully checked the report you sent and managed to reproduce the issue on our side.
 
Please kindly note that Flexmonster stops the loading process and shows the "Dataset is too large" error to prevent the browser from crashing. For your case, we can add an option to cancel the error pop-up displaying and load the data until the browser crashes. Could you please confirm that this option is suitable for you?
 
Our team would like to also mention Flexmonster Data Server - our special server-side tool, that significantly reduces the time of data loading and enables analyzing large datasets.
In some cases, the Data Server works with the expandAllData more efficiently than the direct connect to the data source. You are welcome to test the tool on your side to see if it helps.
For detailed info about Flexmonster Data Server, we kindly recommend browsing the following article: https://www.flexmonster.com/doc/getting-started-with-data-server/.
 
Looking forward to your response.
 
Kind regards,
Milena

Public
Viktor Ürmös December 7, 2020

Hi Milena!
 
Thank you for your answer.
 
Is there any way for configuring the treshold? To add an option for hiding the pop-up notification is a good approach, but the best solution would be to configure the data size(?) or loading time(?). In this case we could experiment with it, and make it configurable also in our application depending the client machine.
 
We will try the Flexmonster Data Server tool also, thanks for the suggestion.
 
One more issue arised in the last days. The import feature is broken, if you are trying to import a bigger file. (for example my previously attached file). This file was generated and exported using Flexmonster (ng-flexmonster, v2.8.19), but we cannot import it. Should I open another question about this?
Thanks in advance,
Ürmös Viktor

Public
Milena Pechura Milena Pechura Flexmonster December 8, 2020

Hi, Viktor,
 
Thank you for your questions.
 
We would like to inform you that our dev team will add an option to configure the loading time.
The feature is going to be provided with a minor release ETA Dec 28. Our team will keep you posted with any updates.
 
Regarding the issue with importing file, we kindly suggest posting a new question about it.
 
Do not hesitate to contact us in case any other questions arise.
 
Best regards,
Milena

Public
Milena Pechura Milena Pechura Flexmonster December 29, 2020

Hello, Viktor,
 
We are pleased to inform you that a new "expandExecutionTimeout" property was added to the Options Object. It allows defining timeout value for the expandAll operation.
 
The new property is included in the 2.8.23 version of Flexmonster: https://www.flexmonster.com/release-notes/.
 
You are welcome to update the component.
Here is our updating to the latest version tutorial for guidance: https://www.flexmonster.com/doc/updating-to-the-latest-version/.
 
Please let us know if everything works.
 
Best regards,
Milena

Public
Milena Pechura Milena Pechura Flexmonster January 21, 2021

Hi, Viktor,
 
Hope you are doing well!
 
We would like to kindly take an interest in whether the recent fix helped.
Could you please let us know if everything works fine?
 
Our team is looking forward to hearing from you.
 
Kind regards,
Milena

Please login or Register to Submit Answer