Skip to main content

Big Data concept everyone must know


Big Data will change our world completely and is not a passing fad that will go away. To understand big data concept it is important to understand five Vs: Volume, Velocity, Variety, Veracity and Value.

1-Volume refers to the vast amounts of data generated every second. Just think of all the emails, twitter messages, photos, video clips, sensor data etc. we produce and share every second. We are not talking Terabytes but Zettabytes or Brontobytes. On Facebook alone we send 10 billion messages per day, click the "like' button 4.5 billion times and upload 350 million new pictures each and every day. If we take all the data generated in the world between the beginning of time and 2008, the same amount of data will soon be generated every minute! This increasingly makes data sets too large to store and analyze using traditional database technology. With big data technology we can now store and use these data sets with the help of distributed systems, where parts of the data is stored in different locations and brought together by software.

2-Velocity refers to the speed at which new data is generated and the speed at which data moves around. Just think of social media messages going viral in seconds, the speed at which credit card transactions are checked for fraudulent activities, or the milliseconds it takes trading systems to analyze social media networks to pick up signals that trigger decisions to buy or sell shares. Big data technology allows us now to analyze the data while it is being generated, without ever putting it into databases.

3-Variety refers to the different types of data we can now use. In the past we focused on structured data that neatly fits into tables or relational databases, such as financial data (e.g. sales by product or region). In fact, 80% of the world’s data is now unstructured, and therefore can’t easily be put into tables (think of photos, video sequences or social media updates). With big data technology we can now harness differed types of data (structured and unstructured) including messages, social media conversations, photos, sensor data, video or voice recordings and bring them together with more traditional, structured data.

4-Veracity refers to the messiness or trustworthiness of the data. With many forms of big data, quality and accuracy are less controllable (just think of Twitter posts with hash tags, abbreviations, typos and colloquial speech as well as the reliability and accuracy of content) but big data and analytics technology now allows us to work with these type of data. The volumes often make up for the lack of quality or accuracy.

5-Value:It is all well and good having access to big data but unless we can turn it into value it is useless. So you can safely argue that 'value' is the most important V of Big Data. It is important that businesses make a business case for any attempt to collect and leverage big data. It is so easy to fall into the buzz trap and embark on big data initiatives without a clear understanding of costs and benefits.



Comments

Post a Comment

Please do not enter any spam link in the comment box.

Popular posts from this blog

Understanding SWOT Analysis and its mechanism

Why SWOT Analysis important With the help of SWOT analysis you can uncover opportunities that you can capitalize on and you can learn and understand about the weaknesses of your business. It also help you detect potential threats and allows you to manage it well in advance and eliminate it. Furthermore, it enables you to formulate a strategy that gives you an edge over your competitor. SWOT analysis can be used in a simple way or as a Strategy tool. Strengths and weaknesses are often internal to your organization, while opportunities and threats generally relate to external factors.SWOT is sometimes called Internal-External Analysis and SWOT Matrix also called an IE Matrix. Strengths Important questions to be considered: ·          What advantages does your organization have? ·          What do you do better than anyone else? ·          What u...
5 comments
Read more

Important considerations for Proposal Writing in Humanitarian/Development sector

A proposal is a request for financial assistance to implement a project. It must be simply more than just a list you want money for. It must be realistic including attainable goal as well as an effective mean to report back to the Donor on whether or not you meeting the goal. Following are components of proposal writing ·          Justification ·          Technical Description ·          Budgeting ·          Reporting Mechanism 1- Justification 1-Problem Statement ·      Problem statement is one paragraph pitch that summaries the project as whole and describes disaster/intervention, major causes, problems and population effected. ·        It must include source and data of this information and any background data ·     It must strike a delicate balance betwe...
3 comments
Read more

Different Kinds of Learning (Loops of Learning), everyone must know.

Single and double-loop learning-concepts have been developed by Chris Argyris and Donald Schon. These theories are based upon”a theory of action” prospective designed by Argyris. However, the origin of triple-loop learning is not well-known. It is clear that triple-loop learning is inspired by Argyris and Schon, but the term does not appear explicitly in their published work. 1-Single-Loop Learning (Following the Rules) The conventional example used to explain this concept is the thermostat. It operates in one mode. When it detects that the room is too cold, it turns on the furnace. When it detects that the room is too hot, it turns off the furnace. In other words, the system includes one automatic and limited type of reaction – little or no learning occurs and little or no insight is needed .Experts assert that most organizations operate according to single-loop learning – members establish rigid strategies, policies and procedures and then spend their time detecting and co...
Post a Comment
Read more