dealsonwheels.co.nz
robots.txt
Robots Exclusion Standard data for dealsonwheels.co.nz
Resource Scan
Scan Details
Site Domain | dealsonwheels.co.nz |
Base Domain | dealsonwheels.co.nz |
Scan Status | Ok |
Last Scan | 2024-06-22T20:36:05+00:00 |
Next Scan | 2024-06-29T20:36:05+00:00 |
Last Scan
Scanned | 2024-06-22T20:36:05+00:00 |
URL | https://dealsonwheels.co.nz/robots.txt |
Redirect | https://www.dealsonwheels.co.nz/robots.txt |
Redirect Domain | www.dealsonwheels.co.nz |
Redirect Base | dealsonwheels.co.nz |
Domain IPs | 13.210.67.40, 3.105.244.185 |
Redirect IPs | 13.210.67.40, 3.105.244.185 |
Response IP | 13.210.67.40 |
Found | Yes |
Hash | c0a8488e95ca3a77c404cdfc3fdcc868c38ca3b813365f46501557ac89deb88a |
SimHash | 7b5ccc725230 |
Groups
*
Rule | Path |
---|---|
Disallow | /umbraco/ |
Disallow | /base/SocialMediaShareStatisticLogger/ |
Disallow | /base/Currency/ |
Disallow | /base/PageStatisticLogger/ |
Disallow | /base/GalleryManagerAjaxApi/ |
Disallow | /base/Poll/ |
Disallow | /base/SpecSearch/ |
Disallow | /base/SpecAjaxApi/ |
Disallow | /base/Editorial/ |
Disallow | /base/ReportAdService/ |
Disallow | /base/SavedItemsAjaxApi/ |
Disallow | /base/EmailAlertsAjaxApi/ |
Disallow | /base/FFSAdSearch/ |
Disallow | /base/AmbAuth/ |
Disallow | /base/ArticleSearch/ |
Disallow | /base/SpecSearchAdmin/ |
Disallow | /base/SchemaSupport/ |
Disallow | /base/CustomerTraceablePhoneNumber/ |
Disallow | /base/Syndication/ |
Disallow | /base/Articles/ |
Disallow | /base/CustomerManagement/ |
Disallow | /base/EnquiryManagement/ |
Disallow | /base/SpecMediaManagement/ |
Disallow | /base/CustomerMediaManagement/ |
Disallow | /base/LinkedCustomerManagement/ |
Disallow | /base/Lookups/ |
Disallow | /base/ForSaleAdSearch/ |
Disallow | /base/ForSaleAdSearchAdmin/ |
Disallow | /base/ArticleSearchDashboard/ |
Disallow | /base/PageRedirect/ |
Disallow | /base/SchemaSeoRuleAdmin/ |
Disallow | /enquire/ |
Disallow | /Enquire/ |
Disallow | /report-ad |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.dealsonwheels.co.nz/nz-dealsonwheels-sitemap.xml |