Home > Uncategorized > Pivotal and EMC are betting on Spark cousin Tachyon as in-memory file system

Pivotal and EMC are betting on Spark cousin Tachyon as in-memory file system

Gigaom

Pivotal, the big data and cloud computing company that spun out of EMC and VMware in 2013, is putting its financial and engineering muscle behind an open source project called Tachyon. Developed at AMPLab, the same University of California, Berkeley group responsible for the wildly popular Apache Spark data-processing framework, Tachyon is a distributed in-memory file system that lets multiple applications access the same data at the same high speed.

In a blog post published Tuesday, Pivotal explained its interest in Tachyon as part of the “data lake” strategy the company is pushing, whereby companies would store all their data using Pivotal’s Hadoop technology and access it using a variety of tools layer on top:

In partnership with the AMPLab at UC Berkeley, Pivotal envisions this future architecture will incorporate an in-memory data exchange platform based on Tachyon and in-memory compute layer augmented by Apache Spark.

The…

View original post 291 more words

Advertisements
Categories: Uncategorized
  1. No comments yet.
  1. No trackbacks yet.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: