compareclub.com.au
robots.txt
Robots Exclusion Standard data for compareclub.com.au
Resource Scan
Scan Details
| Site Domain | compareclub.com.au |
| Base Domain | compareclub.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-08T21:47:42+00:00 |
| Next Scan | 2024-10-08T21:47:42+00:00 |
Last Scan
| Scanned | 2024-09-08T21:47:42+00:00 |
| URL | https://compareclub.com.au/robots.txt |
| Domain IPs | 13.33.88.117, 13.33.88.125, 13.33.88.20, 13.33.88.73 |
| Response IP | 13.33.88.73 |
| Found | Yes |
| Hash | 9da9199b2afc7ce0e84776a73802ecedce3464a3cf7b077f441e53ebdca8d336 |
| SimHash | bb2510da4d53 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */quote/ |
| Disallow | */groceries/ |
| Disallow | /api/ |
| Disallow | /health-insurance/quotes-results/ |
| Disallow | /health-insurance/quote/ |
| Disallow | /health-insurance/visitors-visa-ovhc/quotes-results/ |
| Disallow | /life-insurance/quote/ |
| Disallow | /energy/quote/quick/ |
| Disallow | /home-loans/quote/loan-purpose/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://compareclub.com.au/sitemaps/Health+Insurance/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Life+Insurance/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Home+Loans/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Energy/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Car+Insurance/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Credit+Cards/sitemap.xml |
| sitemap | https://compareclub.com.au/sitemaps/Personal+Loans/sitemap.xml |