nikkansports.com
robots.txt

Robots Exclusion Standard data for nikkansports.com

Resource Scan

Scan Details

Site Domain nikkansports.com
Base Domain nikkansports.com
Scan Status Ok
Last Scan2024-06-13T19:38:31+00:00
Next Scan 2024-06-20T19:38:31+00:00

Last Scan

Scanned2024-06-13T19:38:31+00:00
URL https://nikkansports.com/robots.txt
Redirect https://www.nikkansports.com/robots.txt
Redirect Domain www.nikkansports.com
Redirect Base nikkansports.com
Domain IPs 13.33.88.38, 13.33.88.71, 13.33.88.74, 13.33.88.95
Redirect IPs 13.33.88.38, 13.33.88.71, 13.33.88.74, 13.33.88.95
Response IP 13.33.88.71
Found Yes
Hash d58ceee6ad0910bf797162bc9218819928b299ead4bdc0018bbcb33e16726442
SimHash da14c964a183

Groups

*

Rule Path
Disallow /ajaxlib/

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /