sp.doubutsu-uranai.com
robots.txt

Robots Exclusion Standard data for sp.doubutsu-uranai.com

Resource Scan

Scan Details

Site Domain sp.doubutsu-uranai.com
Base Domain doubutsu-uranai.com
Scan Status Ok
Last Scan2024-11-03T08:36:23+00:00
Next Scan 2024-12-03T08:36:23+00:00

Last Scan

Scanned2024-11-03T08:36:23+00:00
URL https://sp.doubutsu-uranai.com/robots.txt
Domain IPs 13.33.88.103, 13.33.88.121, 13.33.88.31, 13.33.88.38
Response IP 13.33.88.38
Found Yes
Hash 77516897663159dd9caa006fdaabfcf94b432fd552c3f58aac935169d8c25b8c
SimHash 1a26c568f211

Groups

*

Rule Path
Disallow /include/
Disallow /new_questionnaire_good.php
Disallow /new_questionnaire_input.php
Disallow /question_cafe_good.php
Disallow /question_cafe.php
Disallow /tanka.php
Disallow /tanka_good.php
Disallow /tanka_old.php
Disallow /tanka_user.php
Disallow /tanka_user_good.php

googlebot-image

Rule Path
Disallow /images/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

leikibot

Rule Path
Disallow /