Handle large files
How do we plan to handle larger result files?
Pretty standard simulation easily produce CSVs in the 100MB range and larger. Zipping them will likely help a lot. But I am still a bit uncertain if we can stuff everything in Postgres?
How about using an S3 object store for storing the files?
I stumbled upon this issue when implementing the Python code which fill fetch, extract and load the results.