Large dataset upload and download considerations

Upload large datasets from ArcGIS for Desktop

If you want to upload data or files greater than 64 MB (the default heap size of Server Object Container [SOC]) through ArcGIS for Desktop, you need to increase the ArcGIS Server heap size. To increase the heap size, follow the steps described in Geoprocessing service settings: Advanced properties.

Upload large datasets from a web application

Web applications use the Representational State Transfer (REST) Uploads operation to upload files. This capability is set by the Uploads capability on the geoprocessing service property page. The default maximum upload size is 2 GB. If you want to upload larger files, increase the maximum upload sizes by following the steps described in Geoprocessing service settings: Advanced properties.

if the input data is a file such as the format of txt, zip, or jpg, you can use the uploads resource operation to upload these file types. The setup of an upload file type is described in Geoprocessing service settings: Advanced properties.

Feature class output

The configuration of the heap size of Server Object Container [SOC] does not depend on the size of the output feature class obtaining from the client site. Instead, you need to run the service once and check the size of results.dat file, which is the output feature set converted from the output feature class, on the server job directory. If the size of the file is greater than 64 MB, you need to increase the ArcGIS Server heap size to be greater than the size of the file. To increase the heap size, follow the steps described in Geoprocessing service settings: Advanced properties.

One of the parameter settings for a geoprocessing service is Maximum number of records returned by the server. If the output of the geoprocessing service returns a feature class or table containing more records than this setting, the task execution result in the Results window will contain the message <data exceeds transfer limit>. You can reset the Maximum number of records returned by the server parameter of the service as follows:

1. In the Catalog window, make a server administrator connection to the server hosting the service.
2. Right-click the service and select Service Properties.
3. Click the Parameters tab and reset the Maximum number of records returned by the server value.
4. The service will be restarted automatically.

Learn more about task results in the Results window

Maximum time

When working with long running geoprocessing jobs, you may also need to increase the maximum time a client can use a service. You can configure this on the Pooling tab of the Service Properties dialog box. The default is 600 seconds or 10 minutes. See Tuning and configuring services to learn about the time-outs associated with a service.