insidejapantours.com
robots.txt

Robots Exclusion Standard data for insidejapantours.com

Resource Scan

Scan Details

Site Domain insidejapantours.com
Base Domain insidejapantours.com
Scan Status Ok
Last Scan2026-01-24T08:35:48+00:00
Next Scan 2026-02-23T08:35:48+00:00

Last Scan

Scanned2026-01-24T08:35:48+00:00
URL https://insidejapantours.com/robots.txt
Redirect https://www.insidejapantours.com/robots.txt
Redirect Domain www.insidejapantours.com
Redirect Base insidejapantours.com
Domain IPs 104.26.2.150, 104.26.3.150, 172.67.71.166, 2606:4700:20::681a:296, 2606:4700:20::681a:396, 2606:4700:20::ac43:47a6
Redirect IPs 104.26.2.150, 104.26.3.150, 172.67.71.166, 2606:4700:20::681a:296, 2606:4700:20::681a:396, 2606:4700:20::ac43:47a6
Response IP 172.67.71.166
Found Yes
Hash 35de5a90f7581bc9f65125abb0eb5bf6d40ba9c28300a2dc37dd1d56071d1290
SimHash 6b149c52eb01

Groups

*

Rule Path
Disallow /*?
Disallow */?scroll
Disallow */author/
Disallow */tag/
Disallow *setloc%3D

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.insidejapantours.com/sitemap.xml