2 comments on “Designing an All-Flash Object Store
  1. Tim Wessels says:

    Well, Mr. Crump raises some interesting issues with regard to object storage performance. Let’s start with replication and erasure coding. The parameters for replication and erasure coding can be varied based on how much durability is needed to protect against data loss. Writing and reading data using replication is generally faster than erasure coding. Bucket policies can be established to initially replicate data and then erasure code it after a period of time. It is hard to see any technical improvement in replication, but erasure coding does allow for improvement using approaches like hierarchical erasure codes.

    With regard to network performance, all object storage systems can locate data objects very quickly. Production storage servers generally use dual,10 GbE interfaces, which are recommended by most object storage software vendors. The option to use faster Ethernet speeds beyond 10 GbE may appear in reference architecture designs for object storage clusters in the future.

    Storage servers tend not to be CPU-bound and most of them can do quite well with a single, multi-core CPU. They do need adequate amounts of RAM which is usually based on the storage capacity of the server. Performance in object storage clusters improves as the number of storage servers in the cluster increases. More storage servers yield better performance.

    Object storage software is almost universally hardware agnostic. Storage clusters can comprise a heterogeneous mix of new and old servers. Being storage hardware agnostic means that new and replaced storage servers can have the latest and greatest in storage server capabilities and performance. Few, if any, object storage software vendors limit or constrain their deployment to a specific vendor’s hardware. Many have partnerships with hardware ODMs but not exclusive relationships.

    When new storage server architectures are developed, object storage software vendors will develop their software to take advantage of it provided that the new architectures are not proprietary to a particular vendor. It will be interesting to see how object storage software vendors will respond to emerging flash memory architectures.

Comments are closed.

Enter your email address to follow this blog and receive notifications of new posts by email.

Join 21,478 other followers

Blog Stats
  • 831,937 views
%d bloggers like this: