theboardexchange.com.au
robots.txt
Robots Exclusion Standard data for theboardexchange.com.au
Resource Scan
Scan Details
Site Domain | theboardexchange.com.au |
Base Domain | theboardexchange.com.au |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2025-03-07T12:57:48+00:00 |
Next Scan | 2025-06-05T12:57:48+00:00 |
Last Successful Scan
Scanned | 2023-05-07T07:45:40+00:00 |
URL | https://theboardexchange.com.au/robots.txt |
Redirect | https://www.theboardexchange.com.au/robots.txt |
Redirect Domain | www.theboardexchange.com.au |
Redirect Base | theboardexchange.com.au |
Domain IPs | 13.55.191.131 |
Redirect IPs | 104.16.37.104, 104.16.53.104, 2606:4700::6810:2568, 2606:4700::6810:3568 |
Response IP | 104.16.53.104 |
Found | Yes |
Hash | e3d60f04aefed7da27278e570e1c1d5d7d5416cdc9a817f67ca408d05f86ccd7 |
SimHash | 8a411a57e772 |
Groups
*
Rule | Path |
---|---|
Disallow | /client/ |
Disallow | /banners/ |
Disallow | /administration/ |
Disallow | /adverts/search_box/ |
Disallow | /adverts/phone_num/ |
Disallow | /bikes/contact/ |
Disallow | /advert/contact/ |
Disallow | /baby_kids_toddler/contact/ |
Disallow | /admin |
Disallow | /api |
Disallow | /carts |
Disallow | /carts/add_variant |
Disallow | /subscribe/thank_you |
Disallow | /orders/thank_you |
Disallow | /competition/thanks |
Other Records
Field | Value |
---|---|
sitemap | https://www.theboardexchange.com.au/sitemap.xml.gz |
Comments