Table of contents
What is big data
Big data, as the name suggests, means a huge collection of data that cannot be handled by general data processing software. In the field of information science, data ranges from tens of terabytes to petabytes. It was originally used in the context of data mining (data collection). With the spread of the cloud and smartphones around 2010, it began to be used as an important trend word in business. In recent years, it has become mainstream to express using the “three Vs”, which are the initials of volume, velocity, and variety.
Why Big Data Matters
The spread of smartphones and the rapid development of communication technology are pushing up the amount of data distributed around the world. According to the Ministry of Internal Affairs and Communications, compared to 2015, the amount of data distributed in the world in 2020 will be about 2.7 times, and it will grow by an average of 22% per year. In recent years, in addition to user behavior data on the web, all kinds of information such as health information, environmental information, and location information using IoT is sent to the cloud, and utilization is progressing in various situations.
It is difficult to create any significant value just by storing such large amounts of data in the cloud, but in recent years, AI (machine learning) technology has reached a level where it can be put into practical use. Recent AI extracts features from data and performs data classification, prediction, regression, and estimation without human intervention.
There are many examples, regardless of the size of the company, of using big data and AI to dramatically improve the accuracy of search engines such as Google and the recommendation systems of Amazon and Netflix. Therefore, collecting big data in various situations regardless of the field, and analyzing it with AI to find new value is attracting attention from all over the world as an unprecedented business opportunity.