Log In Sign Up

reserven.jp
robots.txt

Robots Exclusion Standard data for reserven.jp

Resource Scan

Scan Details

Site Domain reserven.jp
Base Domain reserven.jp
Scan Status Ok
Last Scan2024-10-29T23:07:35+00:00
Next Scan 2024-11-05T23:07:35+00:00

Last Scan

Scanned2024-10-29T23:07:35+00:00
URL https://reserven.jp/robots.txt
Redirect https://www.reserven.jp/robots.txt
Redirect Domain www.reserven.jp
Redirect Base reserven.jp
Domain IPs 13.225.4.100, 13.225.4.17, 13.225.4.45, 13.225.4.89
Redirect IPs 13.248.131.213, 15.197.152.254, 3.33.161.45, 35.71.150.51
Response IP 35.71.150.51
Found Yes
Hash 764cd52955da7145083a816d2c743a176e5f595404954e158d16e3ffc6d006d5
SimHash aa8c4d8d7550

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://reserven-production.s3.amazonaws.com/sitemaps/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Disallow: /privacy
  • Disallow: /terms
Back to top