teepubble.com
robots.txt
Robots Exclusion Standard data for teepubble.com
Resource Scan
Scan Details
Site Domain | teepubble.com |
Base Domain | teepubble.com |
Scan Status | Ok |
Last Scan | 2024-05-10T04:18:23+00:00 |
Next Scan | 2024-06-09T04:18:23+00:00 |
Last Scan
Scanned | 2024-05-10T04:18:23+00:00 |
URL | https://teepubble.com/robots.txt |
Domain IPs | 104.21.34.19, 172.67.153.53, 2606:4700:3030::ac43:9935, 2606:4700:3034::6815:2213 |
Response IP | 104.21.34.19 |
Found | Yes |
Hash | afa608cefa43aa4e16007768057203ac6a273fb94895e690f32289ad2cb16c75 |
SimHash | 7c314822a7f4 |
Groups
bingbot
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /carts |
Disallow | /account |
Disallow | /shopcart |
Disallow | /wp-content/ |
Disallow | /login |
Disallow | /wp-admin/ |
Disallow | /dtinfo/ |
Disallow | /readme.html |
Disallow | /refer/ |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
pinterestbot
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /carts |
Disallow | /account |
Disallow | /shopcart |
Disallow | /wp-content/ |
Disallow | /login |
Disallow | /wp-admin/ |
Disallow | /dtinfo/ |
Disallow | /readme.html |
Disallow | /refer/ |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /cart |
Disallow | /orders |
Disallow | /checkouts/ |
Disallow | /checkout |
Disallow | /carts |
Disallow | /account |
Disallow | /shopcart |
Disallow | /wp-content/ |
Disallow | /login |
Disallow | /wp-admin/ |
Disallow | /readme.html |
Disallow | /refer/ |
Disallow | / |
Allow | / |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |
*
Rule | Path |
---|---|
Allow | / |
Warnings
- `https` is not a known field.