The report, "Why In-Memory Technology Will Dominate Big Data: In-Memory and the New BI," is authored by
Click to share this story on Twitter: http://clicktotweet.com/3m44w
"If data analysts can get results in seconds or minutes instead of hours, then they can test many more hypotheses than before – and they will. They are also more likely to consider engaging in activities they previously thought impractical, such as adding to their data sources and pursuing new analytical projects," Bloor says.
But Bloor also cautions that the continued use of traditional technology in business intelligence can negate any potential advantage, calling instead for the strategic utilization of in-memory analytics as a preferred method. "Reading from memory is more than 3,300 times faster than reading from disk," he notes. "A simple calculation would suggest that if it takes an hour to read a set of information from disk, it would take just over a second to read it from memory." A solution, he writes, is the deployment of an in-memory analytical platform, one that imports a copy of multiple terabytes of data for analysis from existing data stores, like that being stored in Hadoop implementations.
Bloor cites the Kognitio Analytical Platform as an example of how the "New BI" technology is being successfully used. Bloor notes that Kognitio optimizes all data brought into memory to be accessed on a truly random basis, instead of the block-basis querying used by traditional databases. "With a column store database, an analytical task can be thought of as a three-step process involving reading memory from disk into cache, answering the query and then applying the analytical routine to get a result. With an in-memory architecture, it is a one-step process that runs the query and the analytical calculation in parallel at a much greater speed," he writes. Kognitio, he says, is not only capable of running queries using an industry-standard SQL interface, as well as MDX for OLAP via virtual in-memory cubes. "It can also execute analytical processing, running third-party binaries embedded directly within SQL commands," he adds.