angry.net
robots.txt

Robots Exclusion Standard data for angry.net

Resource Scan

Scan Details

Site Domain angry.net
Base Domain angry.net
Scan Status Ok
Last Scan2024-10-27T03:08:24+00:00
Next Scan 2024-11-03T03:08:24+00:00

Last Scan

Scanned2024-10-27T03:08:24+00:00
URL https://angry.net/robots.txt
Domain IPs 192.34.55.88
Response IP 192.34.55.88
Found Yes
Hash 219610b374968f278e18b8a5e9cfe132e383d6ece48c09b0a3e05b93610b411f
SimHash 65c11840c583

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow images

Other Records

Field Value
crawl-delay 900

mozilla/5.0 (compatible;contxbot/1.0)

Rule Path
Disallow

Other Records

Field Value
sitemap http://www.angry.net/sitemap.xml

Comments

  • robots.txt generated at http://www.mcanerin.com