Big web data: Challenges related to data, technology, legality, and ethics

The digital data available online is currently measured in zettabytes. These vast repositories of big web data are increasingly viewed as a strategic resource comparable in value to land, gold, and oil. This big web data can be extracted and analyzed by organizations to gain a better understanding of their internal and external environment and improve organizational performance. Because of these opportunities, automated retrieval and organization of web data (i.e., web scraping) for research projects is becoming a common practice. This article outlines the data-related, technical, legal, and ethical issues related to web scraping. Awareness of these issues can help researchers save time and resources and, most importantly, mitigate the potential risk of ethical controversies or lawsuits related to the retrieval and use of big web data.& COPY; 2022 Kelley School of Business, Indiana University. Published by Elsevier Inc. All rights reserved.