Can Flatfile handle an upload of more than one million records?

The short answer is yes! But there are some caveats. Flatfile regularly processes files and spreadsheets with over a million rows; however, the viability of doing this depends on *both* the number of rows and the number of columns in the data you need to process.

Important: While Flatfile can successfully upload and process large files, retrieving data is limited to 10,000 records per API call. If you're using sheet.allData() to retrieve processed data, you'll only get the first 10,000 rows. For larger datasets, you must implement pagination using batching techniques during data egress to retrieve all records.

Since the shape of everyone's data is different, if you routinely need to upload files with more than one million rows of data, connect with us at support@flatfile.com and we can give you an answer specific to your needs.