caloo.jp
robots.txt

Robots Exclusion Standard data for caloo.jp

Resource Scan

Scan Details

Site Domain caloo.jp
Base Domain caloo.jp
Scan Status Ok
Last Scan2024-05-15T23:15:52+00:00
Next Scan 2024-05-22T23:15:52+00:00

Last Scan

Scanned2024-05-15T23:15:52+00:00
URL https://caloo.jp/robots.txt
Domain IPs 133.242.28.13, 2401:2500:109:101a:133:242:28:13
Response IP 133.242.28.13
Found Yes
Hash 9c9afb4379ed9d9f82ada13b3e2444e5e78326b31e6c463747f74c2adbdf4c6b
SimHash 6b0e9c81c0b9

Groups

*

Rule Path
Disallow /users/
Allow /users/regist
Allow /users/login
Disallow /reviews/add/
Disallow /doctors/
Disallow /qa/question
Disallow /qa/answer/
Disallow /points/
Disallow /hospitals/history
Disallow /reports/add
Disallow /6873731/
Disallow /apis/
Disallow /tracks/

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

criteobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

sosospider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://caloo.jp/sitefeeds/allhospitals
sitemap https://caloo.jp/sitefeeds/updatehospitals.rss
sitemap https://caloo.jp/sitefeeds/allhospitalreviews
sitemap https://caloo.jp/sitefeeds/hospitalsearch_area_kamok
sitemap https://caloo.jp/sitefeeds/hospitalsearch_station_kamok
sitemap https://caloo.jp/sitefeeds/hospitalsearch_area_disease
sitemap https://caloo.jp/sitefeeds/hospitalsearch_station_by_disease_id