Have Geek Brain

Several 404 requests on our site. Is this an attack or just the wrong indexing robot?

Our site receives requests that try to access already existing pages. This is usually just a spelling address. Like the correct link is /Info/SiteMap.aspx, but a bad request is /Inf/SiteMap.aspx with a missing "o". It usually takes a lot of queries, for example 20 per line in one minute. Everybody rolls 404.

Is this some kind of indexing robot problem? Or is someone testing spaces on our site?

Do you have any experience or advice?

0


a source to share


1 answer


Yes, consider the following things.

  • The IP address of the host making the requests. If they are different from each other, but multiple IP addresses, we can suspect it as a distributed attack carried out with Zombies.

  • ... If the requests come from the same source, check the latency between requests. Typically, crawlers don't use extremely short periods between queries.

  • Indexing robots (scanners) do not perform brute-force indexing. They simply grab links from one page and recursively go page by page. Therefore, the reason for this should not be an indexing robot.

  • Check for any templates. I mean a consistent naming pattern etc.



EX: /Inf/SiteMap.aspx,/Infa/SiteMap.aspx,/Infb/SiteMap.aspx

+1


a source






More articles:


All Articles