shop.freeworker.com
robots.txt

Robots Exclusion Standard data for shop.freeworker.com

Resource Scan

Scan Details

Site Domain shop.freeworker.com
Base Domain freeworker.com
Scan Status Ok
Last Scan2026-01-31T10:03:39+00:00
Next Scan 2026-03-02T10:03:39+00:00

Last Scan

Scanned2026-01-31T10:03:39+00:00
URL https://shop.freeworker.com/robots.txt
Domain IPs 104.26.6.118, 104.26.7.118, 172.67.69.79, 2606:4700:20::681a:676, 2606:4700:20::681a:776, 2606:4700:20::ac43:454f
Response IP 172.67.69.79
Found Yes
Hash 6d8d56c4ca827e76b4dd98554dd0a07121071f826c3f34729ca3b15e2fc4af26
SimHash 481dedc1ed30

Groups

*

Rule Path
Disallow */catalog/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */customer/
Disallow */newsletter/
Disallow */review/
Disallow */wishlist/
Disallow /*?SID=
Disallow /*?gclid=

amazonbot

Rule Path
Disallow /*?*

mj12bot

Rule Path
Disallow /*?*

googlebot

Rule Path
Disallow /*?*

Other Records

Field Value
sitemap https://shop.freeworker.com/media/sitemap/sitemap_en.xml