What is BuBiNG?

BuBiNG is a high-performance, open-source web crawler created by the Laboratory of Web Algorithmics (LAW) at the University of Milan. It is designed to efficiently crawl the web at scale, supporting distributed crawling across multiple machines. BuBiNG is implemented in Java and is notable for its ability to handle high throughput while respecting politeness constraints such as robots.txt and crawl delays. The crawler is highly configurable, allowing users to tailor its behavior for various research and data collection purposes. BuBiNG is widely used in academic and research settings for building web archives, conducting web structure analysis, and collecting large datasets for information retrieval and data mining. Its architecture emphasizes scalability, robustness, and adherence to web standards.

Total recordings for bubing: 9