tabi-mag.jp
robots.txt

Robots Exclusion Standard data for tabi-mag.jp

Resource Scan

Scan Details

Site Domain tabi-mag.jp
Base Domain tabi-mag.jp
Scan Status Ok
Last Scan2024-11-13T14:20:25+00:00
Next Scan 2024-11-20T14:20:25+00:00

Last Scan

Scanned2024-11-13T14:20:25+00:00
URL https://tabi-mag.jp/robots.txt
Domain IPs 162.43.120.121
Response IP 162.43.120.121
Found Yes
Hash b10d81c4424b61bc47ba35758e85f698bb3dde89fc4898a36f248a42f023bfd7
SimHash 481d8a70acbb

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

dotbot
semrushbot
mj12bot
ahrefsbot
baiduspider
grapeshotcrawler
mappy
yandex
feedwordpress

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tabi-mag.jp/sitemap.xml

Comments

  • Disallow Dotbot