zerochan.net
robots.txt

Robots Exclusion Standard data for zerochan.net

Resource Scan

Scan Details

Site Domain zerochan.net
Base Domain zerochan.net
Scan Status Ok
Last Scan2024-06-23T10:25:25+00:00
Next Scan 2024-06-30T10:25:25+00:00

Last Scan

Scanned2024-06-23T10:25:25+00:00
URL https://zerochan.net/robots.txt
Redirect https://www.zerochan.net/robots.txt
Redirect Domain www.zerochan.net
Redirect Base zerochan.net
Domain IPs 104.244.79.230
Redirect IPs 104.244.79.230, 107.189.13.208
Response IP 107.189.13.208
Found Yes
Hash 3bf677927f8f89634dc3a0f8e043615803d6f521ecfa3c8e9b482b990b3febcd
SimHash 72115244bd02

Groups

*

Rule Path
Disallow /forum
Disallow /*?ref=*
Disallow /notifications
Disallow /comments
Disallow /usertags
Disallow /*?justified
Disallow /*?screen
Disallow /*?m=

googlebot
bingbot
slurp
baiduspider
yandex
duckduckbot
sogou spider
exabot
seznambot

Rule Path Comment
Disallow /forum -
Disallow /*?ref=* -
Disallow /notifications -
Disallow /comments -
Disallow /usertags -
Disallow /similar -
Disallow /*?justified -
Disallow /*?screen -
Disallow /*?m= -
Disallow /*xml* -
Disallow /*json* -
Disallow /*?o=*&p= -
Disallow /*%26o%3D*%26p%3D -
Disallow /*?p=*&o= -
Disallow /*%26p%3D*%26o%3D -
Disallow /*?referer= -
Disallow /*?post= -
Disallow /*%5Cu003d http 400

mediapartners-google

Rule Path
Disallow /search

ahrefsbot

Rule Path
Disallow /login
Disallow /register

Comments

  • requires auth
  • requires auth
  • api
  • mixing both page and offset
  • misc