Delete a Message
antp
I see in the logs that some nonfilterable bots make searches that are very heavy for the server, e.g. browse all UK vehicles (there are thousands of pages, no human would just browse all that, sometimes several times in the same few seconds)
In a way it is my fault that they find such link: from the statistics page, there are links to show all cars of a given country, but it has no sense for those with more than a few vehicles.
The easiest way to "fix" that is to limit the search options for users that are not logged in. I assume that visitors won't use too much the advanced searches anyway.
Example of queries that I should block:
At the exact same second, 8 person who request the page 4470 of steam engines with UK origin?
That's for sure bots, but why request 8 times the same thing? That looks more like DDOS than just indexing a site.
In a way it is my fault that they find such link: from the statistics page, there are links to show all cars of a given country, but it has no sense for those with more than a few vehicles.
The easiest way to "fix" that is to limit the search options for users that are not logged in. I assume that visitors won't use too much the advanced searches anyway.
Example of queries that I should block:
At the exact same second, 8 person who request the page 4470 of steam engines with UK origin?
That's for sure bots, but why request 8 times the same thing? That looks more like DDOS than just indexing a site.
161.123.110.152 www.imcdb.org - [20/May/2025:02:21:55 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.1875.72"
89.40.81.245 www.imcdb.org - [20/May/2025:02:21:55 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
93.180.224.189 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
74.110.138.252 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
72.135.194.213 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
188.241.15.246 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.1826.33"
204.242.40.254 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.1826.33"
161.123.90.146 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.4 Safari/605.1.15"
89.40.81.245 www.imcdb.org - [20/May/2025:02:21:55 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
93.180.224.189 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
74.110.138.252 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
72.135.194.213 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36"
188.241.15.246 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.1826.33"
204.242.40.254 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.imcdb.org/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/136.0.0.0 Safari/537.36 Edg/136.0.1826.33"
161.123.90.146 www.imcdb.org - [20/May/2025:02:21:56 +0200] "GET /vehicles.php?class111=111&makeMatch=2&modelInclModel=on&origin=UK&page=4470 HTTP/2.0" 200 33436 "https://www.google.com/" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/18.4 Safari/605.1.15"