Facebook Tackles (Really) Big Data With ‘Project Prism’ | Wired Enterprise | Wired.com

Corona, and it lets you run myriad tasks across a vast collection of Hadoop servers without running the risk of crashing the entire cluster. But the second is more intriguing. It’s called Prism, and it’s a way of running a Hadoop cluster so large that it spans multiple data centers across the globe.

Facebook eliminated the single point of failure in the HDFS platform using a creation it calls AvatarNode, and the open source Hadoop project has followed with a similar solution known as HA NameNode, for high-availability. But that still left the single point of failure on MapReduce. Now, with Corona, Facebook has solved this as well.

But Prism will change that. In short, it automatically replicates and moves data wherever it’s needed across a vast network of computing facilities.

(Full Story: Facebook Tackles (Really) Big Data With ‘Project Prism’ | Wired Enterprise | Wired.com)

Advertisements

No comments yet... Be the first to leave a reply!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: