big data

Bilal Hussain Malik 16/3/25                                Growth in Data (Including Measures of Data) Data expansion has been exponential over the last several decades, driven by the rapid diffusion of digital technologies. The quantification of data, measured in bytes, has reached staggering scales, with common units including terabytes (TB), petabytes (PB), and zettabytes (ZB). Notably, global data production is projected to surpass 180 zettabytes by 2025. This phenomenal growth is fuelled by diverse sources, including: 1. Social networks generating vast amounts of user data. 2. IoT devices and sensors continuously collecting and transmitting data. 3. Online transactions producing large volumes of transactional data. 4. Scientific studies generating massive datasets. The pace of data production has also accelerated with the increasing use of real-time data streams, enabling instant insights and decision-m...

 Bilal Hussain Malik 16/3/25                                                                          Historical development of big data The past history of technology and the increased level of information digitisation form the foundation of the development of big data. Data storage and gathering depended on the capacity of available technologies in the past. The 20th century was historic with the development of data warehouses and databases, which enabled the storage and handling of structured data by organisations in an efficient way. But the "big data" term became mainstream in the early 2000s when the internet, social media, and mobile phones exploded, generating massive volumes of unstructured data. The arrival of distributed computing platforms like Hadoop and NoSQL databases in the mid-2000s ...

Bilal Hussain Malik    16/3/25                                                                           Definition of big data Big Data refers to the vast, complex datasets that typical data processing technologies are unable to handle. It is defined by its defining aspects of volume, the vast magnitude of the data, velocity the speed with which data is generated and processed, and variety the diversity and type of the data, including structured, semi structured, and unstructured. In addition truthfulness ensuring data quality and verifiability and value decision-making utility of data are also important. The primary sources of Big Data include social networks, IoT devices, financial transactions, healthcare records, and government databases, all which generate large amounts of informati...