galantvr4.org
robots.txt

Robots Exclusion Standard data for galantvr4.org

Resource Scan

Scan Details

Site Domain galantvr4.org
Base Domain galantvr4.org
Scan Status Ok
Last Scan2025-05-11T07:57:10+00:00
Next Scan 2025-05-18T07:57:10+00:00

Last Scan

Scanned2025-05-11T07:57:10+00:00
URL https://galantvr4.org/robots.txt
Domain IPs 104.21.62.5, 172.67.217.123, 2606:4700:3031::ac43:d97b, 2606:4700:3035::6815:3e05
Response IP 172.67.217.123
Found Yes
Hash 42920e990bab29ec1f676b5a062bbdb389c6c7f813428b11f1574da60f8634a7
SimHash 0e62d4704613

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /account/
Disallow /goto/
Disallow /go-to/
Disallow /login/
Disallow /register/
Disallow /lost-password/
Disallow /members/
Disallow /online/
Disallow /misc/
Disallow /deferred.php
Disallow /threads/*?view=reaction_score$
Disallow */unread$
Disallow */latest$
Allow /search/$
Disallow /search/*
Allow */threads/post-*
Disallow */post-*
Allow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

boardreader
boardtracker
gigabot
twiceler
dotbot
baidu
baiduspider
baiduspider-video
baiduspider-image
naverbot
sosospider
yandex
youdaobot
yeti
magpie-crawler
magpie-crawler/1.1
magpie-crawler/1
genieo/x.x
spinn3r
spinn3r 3.1
feedwordpress/2012.1218
feedwordpress
spinn3r (spinn3r 3.1)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.galantvr4.org/sitemap.php