Of all the new applications on the market today, Splunk does make one of the best attempts to manage storage. It uses a bucket metaphor to make sure data is in the most performance and cost appropriate storage type. When data is first indexed it goes into a db-hot bucket and then through a series of policies, set by the user, transitions to a warm bucket, a cold bucket and then a frozen bucket. Few modern applications have this level of storage management. However, there is a big problem. Burdening Splunk with all this data management activity detracts from its primary purpose, analyzing data.
In this StorageShort, Storage Switzerland Lead Analyst George Crump discusses the problems with having Splunk manage data.