landcruiserclub.net
robots.txt

Robots Exclusion Standard data for landcruiserclub.net

Resource Scan

Scan Details

Site Domain landcruiserclub.net
Base Domain landcruiserclub.net
Scan Status Ok
Last Scan2024-09-15T18:44:56+00:00
Next Scan 2024-09-22T18:44:56+00:00

Last Scan

Scanned2024-09-15T18:44:56+00:00
URL https://landcruiserclub.net/robots.txt
Domain IPs 104.21.20.167, 172.67.193.56, 2606:4700:3032::ac43:c138, 2606:4700:3036::6815:14a7
Response IP 172.67.193.56
Found Yes
Hash 26d7143a01045fada7813065f54159d38fb53234daf7ba540ef11d6ff4cc85c4
SimHash 8873d83223d3

Groups

boardtracker

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Disallow /community/test/
Disallow /community/account/
Disallow /community/admin.php
Disallow /community/ajax/
Disallow /community/conversations/
Disallow /community/events/birthdays/
Disallow /community/events/monthly
Disallow /community/events/weekly
Disallow /community/find-new/
Disallow /community/forums/-/
Disallow /community/forums/tweets/
Disallow /community/goto/
Disallow /community/help/
Disallow /community/login/
Disallow /community/lost-password/
Disallow /community/media/category/
Disallow /community/media/keyword/
Disallow /community/media/user/
Disallow /community/media/service/
Disallow /community/media/submit/
Disallow /community/misc/style?*
Disallow /community/misc/quick-navigation-menu?*
Disallow /community/online/
Disallow /community/pages/conduct/
Disallow /community/pages/privacy/
Disallow /community/threads/tera-tweet-from-*
Disallow /community/wiki/special/
Disallow /community/whats-new/
Disallow /community/attachments/
Disallow /community/register/register
Disallow /community/account/alerts
Allow /

Other Records

Field Value
sitemap https://landcruiserclub.net/community/sitemap.xml