gadgetbit.com
robots.txt

Robots Exclusion Standard data for gadgetbit.com

Resource Scan

Scan Details

Site Domain gadgetbit.com
Base Domain gadgetbit.com
Scan Status Ok
Last Scan2025-12-20T05:07:51+00:00
Next Scan 2025-12-27T05:07:51+00:00

Last Scan

Scanned2025-12-20T05:07:51+00:00
URL https://gadgetbit.com/robots.txt
Redirect https://www.gadgetbit.com/robots.txt
Redirect Domain www.gadgetbit.com
Redirect Base gadgetbit.com
Domain IPs 209.42.255.1
Redirect IPs 209.42.255.1
Response IP 209.42.255.1
Found Yes
Hash 4cf50e13b760a5d2531c7bb14cac36d70777795a51f00f107559d192847eab58
SimHash 403f5483ef11

Groups

petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot
mj12bot
amazonbot

Rule Path
Disallow /threads/*/reply

*

Rule Path
Disallow /whats-new/
Disallow /account/
Disallow /attachments/
Disallow /goto/
Disallow /posts/
Disallow /login/
Disallow /search/
Disallow /admin.php
Allow /

Other Records

Field Value
sitemap https://www.gadgetbit.co.uk/sitemap.xml