oakleyforum.com
robots.txt

Robots Exclusion Standard data for oakleyforum.com

Resource Scan

Scan Details

Site Domain oakleyforum.com
Base Domain oakleyforum.com
Scan Status Ok
Last Scan2024-11-13T21:53:14+00:00
Next Scan 2024-11-20T21:53:14+00:00

Last Scan

Scanned2024-11-13T21:53:14+00:00
URL https://oakleyforum.com/robots.txt
Redirect https://www.oakleyforum.com/robots.txt
Redirect Domain www.oakleyforum.com
Redirect Base oakleyforum.com
Domain IPs 170.249.192.170
Redirect IPs 170.249.192.170
Response IP 170.249.192.170
Found Yes
Hash 9e1ff9347981d59c129820f0f480f5d6edd82a02d44d420221caf84c7f757a3d
SimHash 043acb40c4a3

Groups

*

Rule Path
Disallow /account/
Disallow /find-new/
Disallow /whats-new/
Disallow /help/
Disallow /goto/
Disallow /login/
Disallow /lost-password/
Disallow /misc/style/
Disallow /online/
Disallow /posts/
Disallow /recent-activity/
Disallow /register/
Disallow /search/
Disallow /admin.php
Disallow /index.php?account%2F
Disallow /index.php?find-new%2F
Disallow /index.php?goto%2F
Disallow /index.php?login%2F
Disallow /index.php?lost-password%2F
Disallow /index.php?misc%2Fstyle%2F
Disallow /index.php?online%2F
Disallow /index.php?posts%2F
Disallow /index.php?recent-activity%2F
Disallow /index.php?register%2F
Disallow /index.php?search%2F
Disallow /conversations/
Disallow /admin.php
Disallow /pember_callback.php

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /
Allow /

Other Records

Field Value
sitemap http://www.oakleyforum.com/sitemap.php