Skip to main content

What is big Data?

Big data, the name itself suggests that it is kind of data which is huge/big. We need to know which data makes to that big/huge level.


#What is Big Data ?
According to IDC ( International Data Corporation ), we define the data as big data based on three parameters viz. Volume, Velocity and Variety.
Volume refers to size of the data. Eg : Millions of tweets posted for every minute
Velocity refers to how fast you need analysis on that data. Eg : In IPL (Cricket) match you need to check which team has more tweets and to display that information, it need to query based on (#CSK) tag or any team tag.
Variety refers to what type of data you have, text/image/audio/sensorinformation/video or any mixture of those. Eg : Facebook is processing your status message(text),photo ( image) and video formats. The data may be structured or unstructured.

According SAS ( another company ) variability and complexity are the two key terms.
Variability refers to how variable that data size and the time at which we are getting that data, it is more like trending data.
Complexity refers to the same as variety term defined in IDC terms. Data is coming from multiple sources in multiple format and we need to process relevant information. Not just blindly joining every information.

#Where is it used?
The organisations which are having the data that has previous properties like Google,Facebook,Twitter etc. We can't decide the big data based on the size of the data. 1 tera byte is a huge amount of data for one organisation, but 1 gb data is a huge amount for another organisation.

#How is it used?
Only defining big data is not worthy. It is defined to do some analytics over that huge amount of data and come out with new information and project new ideas in developing organisation.
To do this, Big data combines with Hadoop (will be posted soon ) framework and yields results.
"Small data is gone. Data is just going to get bigger and bigger and bigger, and people just have to think differently about how they manage it."


Comments

Popular posts from this blog

India - Democracy - Bureaucracy

India a nation with strong Democracy. There has been a well-established democracy in India. This democracy is responsible for the happy and free-living of people in India. Now you people may get a doubt, what has happened to our democracy now. And what is the reason why I’m revolving around the term repeatedly? These would be answered automatically if you go through this article. One of the reasons why India fought for the freedom is to achieve democracy and to end bureaucracy. Before Independence India was run by bureaucrats. And the apex house sitting in Britain would make laws and rules based on the feedback and reports given by the bureaucrats administering India. Due to this Indians suffered a lot and there raised the zeal for self-rule. Moreover, the reports of bureaucrats would always be favoring the interests of Britain and they never bothered about the common people. So to represent the problems faced by the common man and also to solve them we adopted democracy after Indepe…

Atal Innovation Mission - Top 30 Ideas

There is no less of innovation in the young minds of India. To encourage that innovation, AIM (Atal Innovation Mission) has been set up under the NITI Ayog wing. And Atal Tinkering Labs are spread across the country to enable the innovation in the students. After many rounds, top 30 Ideas have been listed here.


Out of these 30 best ideas, a few caught my senses strongly.
Recycling wastewater from automobile garages We often give a water service for our bike/car monthly or weekly. We tend to saw how our vehicle got a new look after servicing. But, the students of  "Jnana Prabodhini Navnagar Vidyala, Nigdi, Pune, Maharashtra" thought something else. They are interested in the wastewater which can be recycled. What an Idea sir ji!
Smart Tap Just like how there is a measurement for electricity, mobile data that we are consuming, there will be a smart tap that measures water coming through that tap. The best part is that the tap also purifies the water. This idea came from the st…

Controlled water management in India

Proper management of water is important in every country and especially in populated countries like India. It is high time that we need to measure our water usage in our homes. Putting a SMART TAP at the water tank would be a necessity in the near future.  Imagine a digital and eco-friendly village. IOT ( internet of things ) is part of their daily life. And their smart tap is used to measure the water usage in the home. And it is connected to the IOT, continuously sends some data related to water flow and quality of water etc.. The smart tap also measures the water level based on the pressure at the tap. And gives you reminders about the water filling. The village officer can analyze the water usage of each house in that village and he can give some incentives/rewards to the less average water usage. In the other post, we have discussed the Aadhaar based dustbins, giving incentives to the villagers for cleanliness. The incentive-based schemes are not the first time to the Govt. or t…