car-moby.jp
robots.txt

Robots Exclusion Standard data for car-moby.jp

Resource Scan

Scan Details

Site Domain car-moby.jp
Base Domain car-moby.jp
Scan Status Ok
Last Scan2024-05-21T21:51:58+00:00
Next Scan 2024-05-28T21:51:58+00:00

Last Scan

Scanned2024-05-21T21:51:58+00:00
URL https://car-moby.jp/robots.txt
Domain IPs 2406:da14:425:200:247:d7d9:8012:5b48, 2406:da14:425:201:bcaa:a149:db40:75b9, 3.115.204.123, 54.168.166.153
Response IP 3.115.204.123
Found Yes
Hash 73c2d454bf48e50e76f1d414370e528eeb6d3c9de5672ca22e806712250c5b45
SimHash 883897c0ccb3

Groups

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /article/wp-admin/

*

Rule Path
Disallow /article/media

*

Rule Path
Disallow /article/media/

*

Rule Path
Disallow /*/feed/$

*

Rule Path
Disallow /*/feed/rss2/$

*

Rule Path
Disallow /usedcar/

mediapartners-google

Rule Path
Disallow

megalodon

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://car-moby.jp/sitemap_index.xml