The Legality of Web Scraping

Web scraping is an automated process of collecting data from websites by using a program or a bot (hence the “automated” part). It’s an extremely efficient way of gathering large amounts of data from one or multiple online sources. Usually, the scraped web pages are first downloaded (fetched). Afterward, data is extracted from them. But – is all of this…

Bot Protection of Websites – Top 10 List – Jan 2022

From the very beginnings of BotMeNot, we have recognized the importance of Bot Protection of Websites. This is why we have decided to start our new monthly Bot Protection series where we rank 10 Websites based on their bot protection scores. By following this series, you’ll be able to know how protected against bots are the websites you visit! Before…

Bot Protection of Websites – Top 10 List – Dec 2021

BotMeNot’s bot protection tests are at the core of its functionality. They are designed to let you know how protected your (or anyone else’s) websites are. Once you do, you’ll be able to take further steps related to improving your website’s bot protection. Bot protection is important because it can mitigate many of the negative effects that bot traffic can…

The Waiting is Over – BotMeNot Beta is Live!

BotMeNot is a bot protection score service that will run several tests on your website to check your bot protection and tell you how protected your website is from bots. So, if you’re interested in finding out how good your websites’ bot protection is, BotMeNot is just the right tool! As you might know, we’ve been developing BotMeNot for quite some time now. But…

DDoS ATTACKS

How to stop DDoS attacks in 2021

What are DDoS attacks? DDoS attack stands for “Distributed Denial-of-Service attack”. However, let’s not get ahead of ourselves. First of all, we need to differentiate between the “regular” denial-of-service attacks (DoS attacks) and the distributed denial-of-service attacks (DDoS attacks).  DoS attacks are a type of cyber-attacks. The objective of a DoS attack is to make a service, machine, or network…

How Bax Shop Fights Bots

There are two perspectives (at least) in every web scraping story: one of the website being scraped and the other of the scraper itself. In this article, we’ll talk about this relationship using a specific example. On one side, there’s Bax Shop, a website selling and renting musical equipment. On the other, there’s Price2Spy – an advanced web crawler, looking…

The History of Bot Protection

According to Wikipedia: Bots are software applications that run automated tasks (scripts) over the internet. You can either say there are “good” and “bad” bots, or you can say that there’s only the “good” or “bad” intent of their user. Either way, the bots we’re talking about here—the “bad” malicious ones, the ones that cause harm and damage—have started evolving…