madamefigaro.jp
robots.txt

Robots Exclusion Standard data for madamefigaro.jp

Resource Scan

Scan Details

Site Domain madamefigaro.jp
Base Domain madamefigaro.jp
Scan Status Ok
Last Scan2024-06-27T00:57:28+00:00
Next Scan 2024-07-04T00:57:28+00:00

Last Scan

Scanned2024-06-27T00:57:28+00:00
URL https://madamefigaro.jp/robots.txt
Domain IPs 52.193.109.152, 57.180.204.235
Response IP 57.180.204.235
Found Yes
Hash 819d53f14bd7555bd5446cf17a97684cce3ce26b0afd6688681a3dcc29771df0
SimHash 045dca72c171

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /25th/
Disallow /sweets/
Disallow /present/171120-skincare.html
Disallow /travel/feature/tel%3B*

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /