whatisnoir.com
robots.txt

Robots Exclusion Standard data for whatisnoir.com

Resource Scan

Scan Details

Site Domain whatisnoir.com
Base Domain whatisnoir.com
Scan Status Ok
Last Scan2025-09-26T14:31:28+00:00
Next Scan 2025-10-03T14:31:28+00:00

Last Scan

Scanned2025-09-26T14:31:28+00:00
URL https://whatisnoir.com/robots.txt
Redirect https://www.whatisnoir.com/robots.txt
Redirect Domain www.whatisnoir.com
Redirect Base whatisnoir.com
Domain IPs 173.236.204.90
Redirect IPs 173.236.204.90
Response IP 173.236.204.90
Found Yes
Hash 5d482bd66fc3afe3df4e992880c33aec7ef32c3aa2221fc8970f75c2539fce6e
SimHash 1238d84a8137

Groups

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Comments

  • AI bots... be gone!