overclockers.com
robots.txt
Robots Exclusion Standard data for overclockers.com
Resource Scan
Scan Details
Site Domain | overclockers.com |
Base Domain | overclockers.com |
Scan Status | Ok |
Last Scan | 2024-11-14T15:06:58+00:00 |
Next Scan | 2024-11-21T15:06:58+00:00 |
Last Scan
Scanned | 2024-11-14T15:06:58+00:00 |
URL | https://overclockers.com/robots.txt |
Domain IPs | 104.21.3.98, 172.67.153.126, 2606:4700:3030::ac43:997e, 2606:4700:3037::6815:362 |
Response IP | 104.21.3.98 |
Found | Yes |
Hash | 8b0555041cf502492bc851d5a17c19fda9b3dd1a00f449746eac4ff6740e23e1 |
SimHash | cd6af73336f5 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin |
Disallow | /wp-content |
Disallow | /wp-login |
Disallow | /feed/ |
Disallow | /comments/feed |
Disallow | /trackback/ |
Disallow | /author/ |
Disallow | /category/ |
Disallow | /tag/ |
Disallow | /comments$ |
Disallow | /?feed= |
Disallow | /wp-comments |
Disallow | /wp-feed |
Disallow | /wp-trackback |
Disallow | /replytocom%3D |
Disallow | /forums/*/add-reply |
Disallow | /forums/*/approve |
Disallow | /forums/*/draft |
Disallow | /forums/*/latest |
Disallow | /forums/*/post |
Disallow | /forums/*/reply |
Disallow | /forums/*/unread |
Disallow | /forums/account/ |
Disallow | /forums/admin.php |
Disallow | /forums/attachments/ |
Disallow | /forums/conversations/ |
Disallow | /forums/find-new/ |
Disallow | /forums/find-threads/ |
Disallow | /forums/forums/*/create-thread |
Disallow | /forums/forums/*/post-thread |
Disallow | /forums/goto/ |
Disallow | /forums/job.php |
Disallow | /forums/login/ |
Disallow | /forums/logout/ |
Disallow | /forums/lost-password/ |
Disallow | /forums/members/ |
Disallow | /forums/misc/ |
Disallow | /forums/online/ |
Disallow | /forums/posts/ |
Disallow | /forums/profile-posts/ |
Disallow | /forums/register/ |
Disallow | /forums/search/ |
Disallow | /forums/search-forums/location |
Disallow | /forums/whats-new/ |
Allow | / |
Allow | /forums |
Other Records
Field | Value |
---|---|
sitemap | https://www.overclockers.com/sitemap_index.xml |
sitemap | https://www.overclockers.com/forums/sitemap.xml |