spam404.com
robots.txt

Robots Exclusion Standard data for spam404.com

Resource Scan

Scan Details

Site Domain spam404.com
Base Domain spam404.com
Scan Status Ok
Last Scan2025-08-17T02:33:37+00:00
Next Scan 2025-08-24T02:33:37+00:00

Last Scan

Scanned2025-08-17T02:33:37+00:00
URL https://spam404.com/robots.txt
Redirect https://www.spam404.com/robots.txt
Redirect Domain www.spam404.com
Redirect Base spam404.com
Domain IPs 199.34.228.56
Redirect IPs 199.34.228.56
Response IP 199.34.228.56
Found Yes
Hash d1caf66e9b0496c50f9b7ec89cae99823e06d52efcf7b73752990b7763e15e39
SimHash ca44dc562fb3

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /failed.html
Disallow /payment-success.html
Disallow /twitter-accounts.html
Disallow /admin.html
Disallow /domains.html

Other Records

Field Value
sitemap https://www.spam404.com/sitemap.xml