Flexmonster Data Server JSON size limit

Answered
Janez asked on May 27, 2024

Hi,

our development team is testing Flexmonster Data Server on following link

https://jsfiddle.net/flexmonster/j1c6rd24/

We would like to know what the JSON max size limit of API response is.

Is it possible to return 400 MB JSON result?

Thank you in advance.

4 answers

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster May 28, 2024

Hello Janez,

Thank you for reaching out to us.a

Flexmonster Data Server can process files more than 1GB — the maximum file size depends on your RAM capacity and the number of unique members in the dataset. From our experience, a 400MB JSON file can be easily loaded into Flexmonster Pivot using Flexmonster Data Server. Also, could you please specify which view type you use (compact/classic or flat)?

The detailed guide you can find in our documentation: https://www.flexmonster.com/doc/getting-started-with-data-server/

You are welcome to contact us if other questions arise.

Kind regards,
Nadia

Public
Janez May 28, 2024

Hi Nadia, thank you for quick response.

I saw this description (text below) on you web page. Can you confirm us if it also applies for JSON data directly from API response (steps- API data request, DB generates data, API response with JSON data) not only for directly JSON file connection (we do understand this as JSON file load from data folder hosted somewhere on server) .

On Flexmonster Pivot we do use all type of views, anyway this is client part, we are ok here.

Thanks, br Janez

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster May 29, 2024

Hi Janez,

Thank you for the response.

We would like to explain that Flexmonster Data Server is a special server-side tool implementing the custom data source API - our communication protocol. The Data Server supports the following data sources:

  • CSV and JSON files
  • MySQL databases
  • MariaDB databases
  • Microsoft SQL Server databases
  • PostgreSQL databases
  • Oracle databases
  • Microsoft Azure SQL databases

Basically, you can connect to the database using Flexmonster Data Server, which aggregates your data and then passes it to Flexmonster Pivot in a ready-to-show format.

If you already have the script that can return the data in the JSON format, it can be set to Flexmonster the following way:

var pivot = new Flexmonster({
container: "pivotContainer",
componentFolder: "node_modules/flexmonster/",
toolbar: true,
report: {
dataSource: {
/* please pay attention to this property,
* Flexmonster needs information
* which data will be returned by the script,
* for example, JSON; */
type: "json",
filename: "URL_to_your_server_side_script"
}
}
});

If the API response returns a 400MB JSON result, all the data from the API response will be stored in the browser. In such cases, Flexmonster relies on resources available to the browser, which affects the loading time and the maximum size of the data that can be handled. Some machines may not handle loading a large dataset into the browser at once. That is why our team suggests using Flexmonster Data Server, which is a more efficient approach for working with large datasets.

For more details on choosing the best data source, we recommend reading the following article: https://www.flexmonster.com/blog/how-to-choose-the-best-data-source-to-use-with-flexmonster/

Please let us know if it works for you. Looking forward to hearing from you.

Kind regards,
Nadia

Public
Nadia Khodakivska Nadia Khodakivska Flexmonster June 5, 2024

Hi Janez,

Hope you are doing well.

We were wondering if our response addressed your questions. Please let us know if you have more questions.

Looking forward to hearing your feedback.

Kind regards,
Nadia

Please login or Register to Submit Answer