Skip to main content

What is big Data?

Big data, the name itself suggests that it is kind of data which is huge/big. We need to know which data makes to that big/huge level.


#What is Big Data ?
According to IDC ( International Data Corporation ), we define the data as big data based on three parameters viz. Volume, Velocity and Variety.
Volume refers to size of the data. Eg : Millions of tweets posted for every minute
Velocity refers to how fast you need analysis on that data. Eg : In IPL (Cricket) match you need to check which team has more tweets and to display that information, it need to query based on (#CSK) tag or any team tag.
Variety refers to what type of data you have, text/image/audio/sensorinformation/video or any mixture of those. Eg : Facebook is processing your status message(text),photo ( image) and video formats. The data may be structured or unstructured.

According SAS ( another company ) variability and complexity are the two key terms.
Variability refers to how variable that data size and the time at which we are getting that data, it is more like trending data.
Complexity refers to the same as variety term defined in IDC terms. Data is coming from multiple sources in multiple format and we need to process relevant information. Not just blindly joining every information.

#Where is it used?
The organisations which are having the data that has previous properties like Google,Facebook,Twitter etc. We can't decide the big data based on the size of the data. 1 tera byte is a huge amount of data for one organisation, but 1 gb data is a huge amount for another organisation.

#How is it used?
Only defining big data is not worthy. It is defined to do some analytics over that huge amount of data and come out with new information and project new ideas in developing organisation.
To do this, Big data combines with Hadoop (will be posted soon ) framework and yields results.
"Small data is gone. Data is just going to get bigger and bigger and bigger, and people just have to think differently about how they manage it."


Popular posts from this blog

India - Democracy - Bureaucracy

India a nation with strong Democracy. There has been a well-established democracy in India. This democracy is responsible for the happy and free-living of people in India. Now you people may get a doubt, what has happened to our democracy now. And what is the reason why I’m revolving around the term repeatedly? These would be answered automatically if you go through this article. One of the reasons why India fought for the freedom is to achieve democracy and to end bureaucracy. Before Independence India was run by bureaucrats. And the apex house sitting in Britain would make laws and rules based on the feedback and reports given by the bureaucrats administering India. Due to this Indians suffered a lot and there raised the zeal for self-rule. Moreover, the reports of bureaucrats would always be favoring the interests of Britain and they never bothered about the common people. So to represent the problems faced by the common man and also to solve them we adopted democracy after Indepe…

God - God Men - Hinduism

God - God Men ------ The title looks something odd. But there is a lot to think about it. Let me begin the article by putting some questions that are lingering in my mind for many years. Question: 1 Whether the existence of GOD has been discussed in Hinduism? If discussed, by whom it was done? And whether the discussion is carried forward in a sensible manner? Question :2 Whether the GOD mentioned in the age-old books of Hindus personified? Question :3 Is the essence of Hinduism wrongly propagated? If yes why? And by whom? If not, the reasons thereof for the present scenario. Question: 4 What does the entity God Men? And where does it come from? Question: 5 Is the varnas mentioned in the great books were correctly carried out and interpreted? “Ohh……! hey please stop it.” ------- you may exclaim in boredom and distress. Though these are irrelevant to present way of life, there may be some questions often attack our mind as I have experienced. Situations may be relevant or not, the present generati…

Atal Innovation Mission - Top 30 Ideas

There is no less of innovation in the young minds of India. To encourage that innovation, AIM (Atal Innovation Mission) has been set up under the NITI Ayog wing. And Atal Tinkering Labs are spread across the country to enable the innovation in the students. After many rounds, top 30 Ideas have been listed here.


Out of these 30 best ideas, a few caught my senses strongly.
Recycling wastewater from automobile garages We often give a water service for our bike/car monthly or weekly. We tend to saw how our vehicle got a new look after servicing. But, the students of  "Jnana Prabodhini Navnagar Vidyala, Nigdi, Pune, Maharashtra" thought something else. They are interested in the wastewater which can be recycled. What an Idea sir ji!
Smart Tap Just like how there is a measurement for electricity, mobile data that we are consuming, there will be a smart tap that measures water coming through that tap. The best part is that the tap also purifies the water. This idea came from the st…