kaigonohonne.com
robots.txt

Robots Exclusion Standard data for kaigonohonne.com

Resource Scan

Scan Details

Site Domain kaigonohonne.com
Base Domain kaigonohonne.com
Scan Status Ok
Last Scan2024-09-28T19:14:45+00:00
Next Scan 2024-10-05T19:14:45+00:00

Last Scan

Scanned2024-09-28T19:14:45+00:00
URL https://kaigonohonne.com/robots.txt
Redirect https://www.kaigonohonne.com/robots.txt
Redirect Domain www.kaigonohonne.com
Redirect Base kaigonohonne.com
Domain IPs 35.74.206.73, 54.199.140.105, 54.249.223.82
Redirect IPs 35.74.206.73, 54.199.140.105, 54.249.223.82
Response IP 54.199.140.105
Found Yes
Hash 380d7bc26a86339bab6bd3a173ba27628e5e6c8319fce215bb3888fc2afcbe94
SimHash de5c4480b77a

Groups

semrushbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

daum

Rule Path
Disallow /

*

Rule Path
Disallow /brochure/
Disallow /optout/

amazonbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*tag*--*
Disallow /*type*--*
Disallow /*?q=
Disallow /*%26q%3D

Comments

  • https://megaindex.com/crawler