daptobikehub.com.au
robots.txt
Robots Exclusion Standard data for daptobikehub.com.au
Resource Scan
Scan Details
Site Domain | daptobikehub.com.au |
Base Domain | daptobikehub.com.au |
Scan Status | Ok |
Last Scan | 2024-11-13T13:48:16+00:00 |
Next Scan | 2024-11-20T13:48:16+00:00 |
Last Scan
Scanned | 2024-11-13T13:48:16+00:00 |
URL | https://daptobikehub.com.au/robots.txt |
Domain IPs | 104.18.4.212 |
Response IP | 104.18.4.212 |
Found | Yes |
Hash | ffd5765c356a53b9d9e8a4a9c5fb949241e82c6906ed5edd8857bc1709e99c8f |
SimHash | 8a418ad7e033 |
Groups
*
Rule | Path |
---|---|
Disallow | /client/ |
Disallow | /banners/ |
Disallow | /administration/ |
Disallow | /adverts/search_box/ |
Disallow | /adverts/phone_num/ |
Disallow | /bikes/contact/ |
Disallow | /advert/contact/ |
Disallow | /baby_kids_toddler/contact/ |
Disallow | /admin |
Disallow | /api |
Disallow | /carts |
Disallow | /carts/add_variant |
Disallow | /subscribe/thank_you |
Disallow | /orders/thank_you |
Disallow | /competition/thanks |
Other Records
Field | Value |
---|---|
sitemap | https://daptobikehub.com.au/sitemap.xml.gz |
Comments