OLAP and Hadoop

Posts Tagged ‘OLAP and Hadoop’

The Big Data Value Continuum – Part 2

This is the second post in a two-part series entitled The Big Data Value ContinuumYou can find Part 1 here.

Recall that in the world of Big Data, our fundamental assumption is that data no longer resides in a static database for its entire life.  Big data demands that we squeak out the most value from the data that we have at every stage of its lifecycle.  And, oh yeah, we’re collecting way more today than we did yesterday, so get ready for that challenge, too.

Part 2: Putting the Pieces Together

Let’s build on the concepts we … Read more

 

OLTP and Decision Support

The purpose of this blog posting is to discuss strategies for handling decision support queries in Online Transaction Processing (OLTP) applications.  First, I want to talk about the two classes of OLTP applications that I see in the marketplace.

The first is the traditional OLTP market that has been present for years, and is typified by purchasing Wall Street stocks.  A collection of humans (stock brokers or end-users over the web) interact with an OLTP system to trade securities.  The brokerage house (and end users for that matter) also want to run decision support queries to learn about historical trends … Read more

 

The Big Data Value Continuum – Part 1

This is the first post in a two-part series entitled The Big Data Value Continuum.  You can find Part 2 here.

Technology markets are challenging enough to understand but, when you throw in the added noise that typically accompanies early markets, gaining real insights can be next to impossible.  It is not unusual to have ten or more vendors in a particular segment and adjacent segments, and countless products attempting to solve similar customer problems. Needless to say, tech markets are rarely clear in the beginning.

Big Data is just such a market today. One of the challenges we … Read more

 

The Sqoop on VoltDB Export and Hadoop Integration

In the last couple of releases of VoltDB, we’ve made steady improvements to our Export feature. Export allows you to build into your VoltDB applications an automatic flow of data from VoltDB to companion datastores (for example, to an analytic database). See this earlier post here.  In this post, I’ll describe some of the improvements we’ve made recently, including integration with Hadoop using Apache Sqoop.

  1. Robustness.  The 1.3 release of VoltDB made great strides in increasing the robustness of the Export functionality, with a primary focus on building a looser coupling between the consumers of the Export data and
  2. Read more

 

VoltDB Export – Connecting VoltDB to Other Systems

VoltDB is an in-memory database that excels at handling massive volumes of read and write operations in real-time.

However, performing high throughput database operations is often only one aspect of the larger business context where data needs to transition from system to system as part of an overall infrastructure. VoltDB provides powerful interoperability features that allow you to select, enrich and distribute data to downstream file systems and databases.

The target for exporting data from VoltDB may be another database, a repository (such as a sequential log file), or a process (such as a system monitor or accounting system). No … Read more