beckertime.com
robots.txt
Robots Exclusion Standard data for beckertime.com
Resource Scan
Scan Details
Site Domain | beckertime.com |
Base Domain | beckertime.com |
Scan Status | Ok |
Last Scan | 2024-09-17T00:59:41+00:00 |
Next Scan | 2024-10-17T00:59:41+00:00 |
Last Scan
Scanned | 2024-09-17T00:59:41+00:00 |
URL | https://beckertime.com/robots.txt |
Domain IPs | 172.66.40.184, 172.66.43.72 |
Response IP | 172.66.40.184 |
Found | Yes |
Hash | cb0a26426aa0094673d5f596e6d2ec71164770f1133e9fc157de8d984da5591a |
SimHash | 641c8b215253 |
Groups
*
Rule | Path |
---|---|
Allow | / |
googlebot
Rule | Path |
---|---|
Disallow | /shop/?* |
Disallow | */?orderby=* |
Disallow | /shop/?add-to-cart=* |
Disallow | */?s=* |
Disallow | */?filter_* |
Disallow | */?view=* |
Disallow | /search/* |
Disallow | */?add-to-cart=* |
Disallow | /?add-to-cart=* |
Disallow | /cart/ |
Disallow | /checkout/ |
Disallow | /my-account/ |
Disallow | */my-account/* |
Disallow | /*undo_item%3D* |
Disallow | /thanks/ |
Disallow | /unsubscribe-2/ |
Disallow | /thanks-for-commenting/ |
Disallow | /thank-you/ |
Disallow | /my-account/email-subscriptions/ |
Disallow | /pa_* |
Disallow | /attachment-sitemap.xml |
Other Records
Field | Value |
---|---|
sitemap | https://beckertime.com/sitemap_index.xml |