Infobright’s column-oriented database plus the Knowledge Grid architecture result in data compression of 10:1 – 40:1 and more. The benefit is faster query response and a significant reduction in storage costs.
Watch our short video explaining how Infobright compression works by going to the Webcast page and selecting “Data Compression Using Infobright”.
Read the blog post on Compression.
Managing large volumes of data continues to be a problem. Even though the costs of data storage have declined, data continues to increase at a very rapid rate. At the same time disk transfer rates have not increased significantly and more disks create additional problems, such as expanding back-up times, and additional management overhead.
The reality is that data compression can significantly reduce the problems of rapidly expanding data. With Infobright, a 10 TB database becomes 1 TB database. Since the data is much smaller the disk transfer rate is improved (even with the overhead of compression).
Unlike traditional row-based data warehouses, Infobright stores data in columns, allowing compression algorithms to be finely tuned to the column data type. Moreover, for each column, the data is split into Data Packs with each storing up to 65,536 values of a given column. Infobright then applies a set of patent-pending compression algortihms that are optimized by automatically self-adjusting various parameters of the algorithm for each data pack.
An average compression ratio of 10:1 is achieved in Infobright. For example 10TB of raw data can be stored in about 1TB of space on average (including the overhead associated with Data Pack Nodes and the Knowledge Grid). Other database systems increase the data size because of the additional overhead required to create indexes and other special structures, in some cases by a factor of 2 or more. Even database systems with compression rarely exceed compression ratios of 1 to 1.
Within Infobright, the compression ratio may differ depending on data types and content. Additionally, some data may turn out to be more repetitive than others, resulting in compression ratios as high as 40:1.
For more information, download the Infobright Architecture White Paper, available on the White Paper page under Infobright technical white papers.