How to use NFS to make Blobs more efficient
Christian Theune <firstname.lastname@example.org>
When handling blobs, the biggest goal is to avoid writing operations that require the blob data to be transferred using up IO resources.
When bringing a blob into the system, at least one O(N) operation has to happen, e.g. when the blob is uploaded via a network server. The blob should be extracted as a file on the final storage volume as early as possible, avoiding further copies.
In a ZEO setup, all data is stored on a networked server and passed to it using zrpc. This is a major problem for handling blobs, because it will lock all transactions from committing when storing a single large blob. As a default, this mechanism works but is not recommended for high-volume installations.