Data is everywhere; it is flowing through the air (Wireless), underneath the earth (cables) and in the sea (Submarine cables).
Digital data is growing exponentially every day. Data that was generated from dawn of civilization till 2003 is now created in just 2 days and the pace is increasing [Schmidt10]. If this trend continues, then the amount of data is going to double every two years.
The traditional technologies that were used for computation and storage are not able to handle this high volume, velocity and variety of data called “Big Data”. So, new technologies have emerged which have broken the established design practices to manage this Big Data.
The Big Data has also become a buzzword today. There are many concepts that are associated with it by various businesses in order to suit their needs. It has made the word “Big Data” very confusing.
This blog series attempts to elucidate the term “Big Data” by surveying various technical whitepapers and standard definitions on Big Data. It also provides an in depth analysis of dynamics of a Big Data system with respect to the challenges thrown by data at rest and data in motion. It provides solution to these challenges by building a reference architecture and recommending the best suited technology currently available for each component
The blog is organized as follows
Digital data is growing exponentially every day. Data that was generated from dawn of civilization till 2003 is now created in just 2 days and the pace is increasing [Schmidt10]. If this trend continues, then the amount of data is going to double every two years.
The traditional technologies that were used for computation and storage are not able to handle this high volume, velocity and variety of data called “Big Data”. So, new technologies have emerged which have broken the established design practices to manage this Big Data.
The Big Data has also become a buzzword today. There are many concepts that are associated with it by various businesses in order to suit their needs. It has made the word “Big Data” very confusing.
This blog series attempts to elucidate the term “Big Data” by surveying various technical whitepapers and standard definitions on Big Data. It also provides an in depth analysis of dynamics of a Big Data system with respect to the challenges thrown by data at rest and data in motion. It provides solution to these challenges by building a reference architecture and recommending the best suited technology currently available for each component
The blog is organized as follows
