Log In Sign Up

shonenjump.viz.com
robots.txt

Robots Exclusion Standard data for shonenjump.viz.com

Resource Scan

Scan Details

Site Domain shonenjump.viz.com
Base Domain viz.com
Scan Status Ok
Last Scan2024-05-26T00:51:05+00:00
Next Scan 2024-06-25T00:51:05+00:00

Last Scan

Scanned2024-05-26T00:51:05+00:00
URL https://shonenjump.viz.com/robots.txt
Redirect https://www.viz.com/robots.txt
Redirect Domain www.viz.com
Redirect Base viz.com
Domain IPs 44.194.52.144, 52.4.64.42, 54.161.7.129, 54.174.111.218, 54.235.116.137
Redirect IPs 13.224.163.129, 13.224.163.57, 13.224.163.59, 13.224.163.86
Response IP 108.157.254.40
Found Yes
Hash 9d86358d27d97fe445fa55b770f17e9af7c874a72f7e3dfb1f16242c262249a7
SimHash b687fdaf776c

Groups

*

Rule Path
Disallow /search
Disallow /comments
Disallow /votes
Disallow /load_dynamic_info
Disallow /products
Disallow /profiles
Disallow *.php
Disallow /manga
Disallow /account
Disallow /news
Disallow /node
Disallow /info
Disallow /moderate

Other Records

Field Value
crawl-delay 2
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top