doubutsu-uranai.com
robots.txt

Robots Exclusion Standard data for doubutsu-uranai.com

Resource Scan

Scan Details

Site Domain doubutsu-uranai.com
Base Domain doubutsu-uranai.com
Scan Status Ok
Last Scan2024-11-04T23:51:24+00:00
Next Scan 2024-11-11T23:51:24+00:00

Last Scan

Scanned2024-11-04T23:51:24+00:00
URL https://www.doubutsu-uranai.com/robots.txt
Domain IPs 18.155.68.111, 18.155.68.27, 18.155.68.4, 18.155.68.60
Response IP 18.155.68.60
Found Yes
Hash aef21eacef551a1d200a864039613b0dc2b0e2a76bb70b75d0d4fc18e115f813
SimHash 1a36c5687611

Groups

*

Rule Path
Disallow /include/
Disallow /rakuten/
Disallow /new_questionnaire_good.php
Disallow /new_questionnaire_input.php
Disallow /question_cafe_good.php
Disallow /question_cafe.php
Disallow /tanka.php
Disallow /tanka_good.php
Disallow /tanka_old.php
Disallow /tanka_user.php
Disallow /tanka_user_good.php

googlebot-image

Rule Path
Disallow /images/

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

leikibot

Rule Path
Disallow /