Log In Sign Up

ssl.syosetu.com
robots.txt

Robots Exclusion Standard data for ssl.syosetu.com

Resource Scan

Scan Details

Site Domain ssl.syosetu.com
Base Domain syosetu.com
Scan Status Ok
Last Scan2025-09-03T14:37:55+00:00
Next Scan 2025-09-10T14:37:55+00:00

Last Scan

Scanned2025-09-03T14:37:55+00:00
URL https://ssl.syosetu.com/robots.txt
Domain IPs 203.137.165.188, 203.137.165.222, 203.137.167.53
Response IP 203.137.165.188
Found Yes
Hash 9318c06ce3d7d56ee7ba35092bce6bb78887175dafa56019445c5e18f78e5dfa
SimHash 2f06c020e332

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mediapartners-google

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

meta-externalagent/1.1 (+https://developers.facebook.com/docs/sharing/webmasters/crawler)

Rule Path
Disallow /

meta-externalagent/1.1

Rule Path
Disallow /
Back to top