cleaningstuff.net
robots.txt

Robots Exclusion Standard data for cleaningstuff.net

Resource Scan

Scan Details

Site Domain cleaningstuff.net
Base Domain cleaningstuff.net
Scan Status Ok
Last Scan2024-09-22T08:05:26+00:00
Next Scan 2024-10-22T08:05:26+00:00

Last Scan

Scanned2024-09-22T08:05:26+00:00
URL https://cleaningstuff.net/robots.txt
Redirect https://www.cleaningstuff.net/robots.txt
Redirect Domain www.cleaningstuff.net
Redirect Base cleaningstuff.net
Domain IPs 192.200.160.18
Redirect IPs 192.200.160.18
Response IP 192.200.160.18
Found Yes
Hash 4c568507f3ad03984953dc1a670601ff677ceecd15b9da609e882361a1253166
SimHash 2b0888904b15

Groups

*

Rule Path
Disallow /account.php
Disallow /cart.php
Disallow /checkout.php
Disallow /finishorder.php
Disallow /login.php
Disallow /orderstatus.php
Disallow /postreview.php
Disallow /productimage.php
Disallow /productupdates.php
Disallow /remote.php
Disallow /search.php
Disallow /viewfile.php
Disallow /wishlist.php
Disallow /admin/
Disallow /__socialshop/

google-xrawler

Rule Path
Allow /feeds/*

*

Rule Path
Disallow /*?_bc_fsnf=1*
Disallow /*%26_bc_fsnf%3D1*

Other Records

Field Value
sitemap https://www.cleaningstuff.net/xmlsitemap.php