Log In Sign Up

reserven.jp
robots.txt

Robots Exclusion Standard data for reserven.jp

Resource Scan

Scan Details

Site Domain reserven.jp
Base Domain reserven.jp
Scan Status Ok
Last Scan2024-09-24T22:00:46+00:00
Next Scan 2024-10-01T22:00:46+00:00

Last Scan

Scanned2024-09-24T22:00:46+00:00
URL https://reserven.jp/robots.txt
Redirect https://www.reserven.jp/robots.txt
Redirect Domain www.reserven.jp
Redirect Base reserven.jp
Domain IPs 13.225.4.100, 13.225.4.17, 13.225.4.45, 13.225.4.89
Redirect IPs 34.201.80.84, 54.157.4.65, 54.196.16.164, 54.91.6.89
Response IP 34.201.80.84
Found Yes
Hash 764cd52955da7145083a816d2c743a176e5f595404954e158d16e3ffc6d006d5
SimHash aa8c4d8d7550

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://reserven-production.s3.amazonaws.com/sitemaps/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
  • Disallow: /privacy
  • Disallow: /terms
Back to top