Log In Sign Up

tokyo-calendar.jp
robots.txt

Robots Exclusion Standard data for tokyo-calendar.jp

Resource Scan

Scan Details

Site Domain tokyo-calendar.jp
Base Domain tokyo-calendar.jp
Scan Status Ok
Last Scan2024-11-01T03:48:19+00:00
Next Scan 2024-11-08T03:48:19+00:00

Last Scan

Scanned2024-11-01T03:48:19+00:00
URL https://tokyo-calendar.jp/robots.txt
Domain IPs 13.33.88.14, 13.33.88.36, 13.33.88.58, 13.33.88.79
Response IP 13.33.88.58
Found Yes
Hash 64f0b8eeed1126fed1419990a92a541239f11404d75e2ce905fc69d343c233c2
SimHash 62958c8562e4

Groups

*

Rule Path
Disallow /members/
Disallow /commons/
Disallow /owners/
Disallow /admin/
Disallow /500.ja.html
Disallow /500.en.html
Disallow /health_check.html
Disallow /modal_form_complete.html
Disallow /redirect.html
Disallow /sorry.html
Disallow /w_test.html
Disallow /reserved_seat/
Disallow /user_sign_up/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://tokyo-calendar.jp/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
Back to top