![]() ![]() Users can search by typing in their own queries or via an API. Secondly, Komprise enables users to search all their data using that global index. The company claims customers can save 80% of the cost of unstructured data storage by moving data to cheaper storage. “So anything you point us at it, we not only give you analytics on how much you have and you know how much it’s costing you, but in the background we actually create a full index of all the data.”īy tracking the age of data and how often it’s used, Komprise can help identify data that’s no longer providing value and empower users to cull it. “When you point Komprise it at your different storage environments, what Komprise does is it quickly indexes all the data,” Subramanian said. While individual data storage providers may provide a view into their particular silo, Komprise delivers a global index that tracks metadata, such as file name, directory name, file owner, data created, data modified, where it’s located, and how long it’s been around, across multiple data silos. According to Subramanian, there are four main benefits that Komprise’s software delivers to customers.įirst is visibility into all of a customer’s unstructured data. Komprise’s tools provide a variety of capabilities for unstructured data management. We needed a data management software service which does exactly that.” Global View of Unstructured Data “What we really need is a software solution that can look at data no matter where it’s stored, can tell us how much data we have, can tell us what’s hot, what’s cold, how much it’s costing us, who’s using it, and then it can move data from one place to another,” Subramanian said. But what they needed was software that could look across all the data silos and create a unified view of it. The storage aspect of the unstructured data management problem has been solved, thanks to object and distributed file systems. We know how to manage databases, but this data is a beast,’” Subramanian said. Unstructured data is pretty much everything that isn’t stored in a database (Andrea-Danti/Shutterstock) Before founding Komprise in 2014, the trio often discussed the unstructured data management problem with previous customers. Komprise is the third startup for Subramanian and her co-founders, CEO Kumar Goswami and CTO Michael Peercy, with their last startup being acquired by Citrix Systems. So IT doesn’t often know why are people creating this data, how fast does it growing, and what data is actually hot and what’s cold.” ‘No Good Tools’ ![]() “Users are generating data, applications are generating data, and IT is usually just tasked with storing and protecting that data. “Most companies have many, many storage silos in different data centers where this data is sitting, and quite often, they just don’t even know how much data they have,” she continued. Very quickly it’s gone from 10 terabytes look looking like a big number to now we have customers that are 100 petabytes-plus and they’re already thinking exabytes,” Subramanian told Datanami. “You have to understand that unstructured data is growing massively. But they never seem to delete data or drain the data lakes, and so the data just keeps growing. It’s so easy to spin up another data lake, and so that’s the approach taken by many organizations. Today’s distributed file systems and cloud object stores have practically unlimited storage capacities. The problem with unstructured data is that it keeps on growing. In 2022, IDC said 175 ZB will be created by 2025 (Image courtesy IDC) “So it’s data that’s generally stored as files or as objects in the cloud.” “When we say unstructured data, what we mean by that is any data that’s not sitting in a database, which is pretty much 85% to 90% of all data today,” Subramanian said. It includes words and pictures, and many things in between, such as PDFs and emails, but also some very big data sources, like genomics, X-rays, digital pathology, and log data from autonomous vehicles. Krishna Subramanian, the president, COO, and co-founder at unstructured data management software vendor Komprise, recently shared some insights into the unique problems posed by unstructured data management, as well as how her company is addressing those needs with the latest release of Komprise’s software.Įighty-five to 90% of the world’s data is unstructured, according to Subramanian. So what’s an unstructured-data hoarder to do? While many want to get value out of it with AI and advanced analytics, the simple act of keeping it costs money and increases security and privacy risks. Organizations today may have petabytes of the stuff spread around various object stores and file systems in the cloud and on-prem. Unstructured data accounts for the vast majority of data stored in the world today, and it’s growing at a geometric rate. ![]()
0 Comments
Leave a Reply. |