freefielder.jp
robots.txt

Robots Exclusion Standard data for freefielder.jp

Resource Scan

Scan Details

Site Domain freefielder.jp
Base Domain freefielder.jp
Scan Status Ok
Last Scan2024-09-23T09:14:43+00:00
Next Scan 2024-09-30T09:14:43+00:00

Last Scan

Scanned2024-09-23T09:14:43+00:00
URL https://freefielder.jp/robots.txt
Domain IPs 207.58.161.148
Response IP 207.58.161.148
Found Yes
Hash ebcf48d161d77f9127c2110777d635719db16c53f00ef5d9a548e9f77bda8ecb
SimHash bc5b68c881f3

Groups

*

Rule Path
Disallow /pictxt/
Disallow /misc/
Disallow /test/
Disallow /amazon/creation/
Disallow /ranking/rssfetch/
Disallow /ranking/scroll/
Disallow /iat/jump.php
Disallow /iat/iat.php
Disallow /speedreducer/
Disallow /lab/h2v/
Disallow /lab/ruby/
Disallow /amazon/
Disallow /photo.html
Disallow /archives.html
Disallow /magicreate/

mj12bot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /