madamefigaro.jp
robots.txt

Robots Exclusion Standard data for madamefigaro.jp

Resource Scan

Scan Details

Site Domain madamefigaro.jp
Base Domain madamefigaro.jp
Scan Status Ok
Last Scan2024-11-14T09:58:17+00:00
Next Scan 2024-11-21T09:58:17+00:00

Last Scan

Scanned2024-11-14T09:58:17+00:00
URL https://madamefigaro.jp/robots.txt
Domain IPs 35.79.206.3, 52.197.43.22
Response IP 35.79.206.3
Found Yes
Hash 819d53f14bd7555bd5446cf17a97684cce3ce26b0afd6688681a3dcc29771df0
SimHash 045dca72c171

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /25th/
Disallow /sweets/
Disallow /present/171120-skincare.html
Disallow /travel/feature/tel%3B*

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /