Web scraping is an automated process of collecting data from websites by using a program or a bot (hence the “automated” part). It’s an extremely efficient way of gathering large amounts of data from one or multiple online sources. Usually, the scraped web pages are first downloaded (fetched). Afterward, data is extracted from them. But – is all of this…
From the very beginnings of BotMeNot, we have recognized the importance of Bot Protection of Websites. This is why we have decided to start our new monthly Bot Protection series where we rank 10 Websites based on their bot protection scores. By following this series, you’ll be able to know how protected against bots are the websites you visit! Before…
BotMeNot’s bot protection tests are at the core of its functionality. They are designed to let you know how protected your (or anyone else’s) websites are. Once you do, you’ll be able to take further steps related to improving your website’s bot protection. Bot protection is important because it can mitigate many of the negative effects that bot traffic can…
BotMeNot is a bot protection score service that will run several tests on your website to check your bot protection and tell you how protected your website is from bots. So, if you’re interested in finding out how good your websites’ bot protection is, BotMeNot is just the right tool! As you might know, we’ve been developing BotMeNot for quite some time now. But…
What are DDoS attacks? DDoS attack stands for “Distributed Denial-of-Service attack”. However, let’s not get ahead of ourselves. First of all, we need to differentiate between the “regular” denial-of-service attacks (DoS attacks) and the distributed denial-of-service attacks (DDoS attacks). DoS attacks are a type of cyber-attacks. The objective of a DoS attack is to make a service, machine, or network…
There are two perspectives (at least) in every web scraping story: one of the website being scraped and the other of the scraper itself. In this article, we’ll talk about this relationship using a specific example. On one side, there’s Bax Shop, a website selling and renting musical equipment. On the other, there’s Price2Spy – an advanced web crawler, looking…
According to Wikipedia: Bots are software applications that run automated tasks (scripts) over the internet. You can either say there are “good” and “bad” bots, or you can say that there’s only the “good” or “bad” intent of their user. Either way, the bots we’re talking about here—the “bad” malicious ones, the ones that cause harm and damage—have started evolving…
