overclockers.com
robots.txt

Robots Exclusion Standard data for overclockers.com

Resource Scan

Scan Details

Site Domain overclockers.com
Base Domain overclockers.com
Scan Status Ok
Last Scan2024-11-14T15:06:58+00:00
Next Scan 2024-11-21T15:06:58+00:00

Last Scan

Scanned2024-11-14T15:06:58+00:00
URL https://overclockers.com/robots.txt
Domain IPs 104.21.3.98, 172.67.153.126, 2606:4700:3030::ac43:997e, 2606:4700:3037::6815:362
Response IP 104.21.3.98
Found Yes
Hash 8b0555041cf502492bc851d5a17c19fda9b3dd1a00f449746eac4ff6740e23e1
SimHash cd6af73336f5

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-content
Disallow /wp-login
Disallow /feed/
Disallow /comments/feed
Disallow /trackback/
Disallow /author/
Disallow /category/
Disallow /tag/
Disallow /comments$
Disallow /?feed=
Disallow /wp-comments
Disallow /wp-feed
Disallow /wp-trackback
Disallow /replytocom%3D
Disallow /forums/*/add-reply
Disallow /forums/*/approve
Disallow /forums/*/draft
Disallow /forums/*/latest
Disallow /forums/*/post
Disallow /forums/*/reply
Disallow /forums/*/unread
Disallow /forums/account/
Disallow /forums/admin.php
Disallow /forums/attachments/
Disallow /forums/conversations/
Disallow /forums/find-new/
Disallow /forums/find-threads/
Disallow /forums/forums/*/create-thread
Disallow /forums/forums/*/post-thread
Disallow /forums/goto/
Disallow /forums/job.php
Disallow /forums/login/
Disallow /forums/logout/
Disallow /forums/lost-password/
Disallow /forums/members/
Disallow /forums/misc/
Disallow /forums/online/
Disallow /forums/posts/
Disallow /forums/profile-posts/
Disallow /forums/register/
Disallow /forums/search/
Disallow /forums/search-forums/location
Disallow /forums/whats-new/
Allow /
Allow /forums

flipboard

Rule Path
Allow /

flipboardproxy

Rule Path
Allow /

grapeshot

Rule Path
Allow /

ias_crawler

Rule Path
Allow /

ias_wombles

Rule Path
Allow /

admantx

Rule Path
Allow /

apis-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

googlebot

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

google-read-aloud

Rule Path
Allow /

googleweblight

Rule Path
Allow /

storebot-google

Rule Path
Allow /

google-site-verification

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.overclockers.com/sitemap_index.xml
sitemap https://www.overclockers.com/forums/sitemap.xml