nicoclub.com
robots.txt
Robots Exclusion Standard data for nicoclub.com
Resource Scan
Scan Details
Site Domain | nicoclub.com |
Base Domain | nicoclub.com |
Scan Status | Ok |
Last Scan | 2024-05-26T03:18:10+00:00 |
Next Scan | 2024-06-02T03:18:10+00:00 |
Last Scan
Scanned | 2024-05-26T03:18:10+00:00 |
URL | https://nicoclub.com/robots.txt |
Redirect | https://www.nicoclub.com/robots.txt |
Redirect Domain | www.nicoclub.com |
Redirect Base | nicoclub.com |
Domain IPs | 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405 |
Redirect IPs | 104.26.12.97, 104.26.13.97, 172.67.68.5, 2606:4700:20::681a:c61, 2606:4700:20::681a:d61, 2606:4700:20::ac43:4405 |
Response IP | 104.26.12.97 |
Found | Yes |
Hash | 3a9acbaf5f1649ebfd7957e9a070a9c3d117cddde6860a317feca3588dd131de |
SimHash | 639f526bc9d4 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /temp/ |
Disallow | /Library/ |
Disallow | /submenus/ |
Disallow | /Templates/ |
Disallow | /Greg/ |
Disallow | /Matt/ |
Disallow | /test/ |
Disallow | /test1/ |
Disallow | /Torry/ |
Disallow | /FSM/ |
Disallow | /forums/ |
Allow | /forums/images/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.nicoclub.com/sitemap.xml |