Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
info
Noteinfo

Important

Enable this feature only with Swarm 15 and later versions; do not enable this feature with Swarm 14 and earlier versions.

Note

Multipart Write was previously referred to as Parallel Write; the functionality is the same.

Parts of a large object from multiple clients at the same time can be uploaded with Multipart Write. Multipart Write allows client applications to split a large file into multiple pieces, transfer the pieces concurrently to Swarm, and then request that Swarm combine the separately uploaded parts together as a single object, thereby minimizing the upload time.

Multipart write requires erasure coding (EC)Erasure Coding ECErasure Coding EC. The health processor (HP) has the ability to can consolidate segments of erasure-coded objects with sub-optimal segment usage, as can happen when performing SCSP or S3 multipart writes of objects using small parts. DataCore recommends configuring clients to use 50MB–100MB parts. Set the configuration setting, ec.segmentConsolidationFrequency, to 10 (recommended), which performs all consolidations over 20 HP cycles if consolidation is needed.

...

  1. Initiate a multipart write.

  2. Upload or copy the parts.

  3. Complete or cancel the procedure.

...