arcticwolf.com
robots.txt

Robots Exclusion Standard data for arcticwolf.com

Resource Scan

Scan Details

Site Domain arcticwolf.com
Base Domain arcticwolf.com
Scan Status Ok
Last Scan2024-11-04T12:10:38+00:00
Next Scan 2024-11-18T12:10:38+00:00

Last Scan

Scanned2024-11-04T12:10:38+00:00
URL https://arcticwolf.com/robots.txt
Domain IPs 18.161.111.39, 18.161.111.60, 18.161.111.81, 18.161.111.82
Response IP 65.9.112.77
Found Yes
Hash 72637aed5ae4124bd6c00e7798afdff3a83847401328e64d4273a6e907b7c329
SimHash 58907940e095

Groups

anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
friendlycrawler
gptbot
imagesiftbot
img2dataset
omgili
omgilibot
perplexitybot
youbot

Rule Path
Disallow /

*

Rule Path
Disallow /resource/_pfcdn/