hipages.com.au
robots.txt
Robots Exclusion Standard data for hipages.com.au
Resource Scan
Scan Details
| Site Domain | hipages.com.au |
| Base Domain | hipages.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-17T22:00:32+00:00 |
| Next Scan | 2024-12-01T22:00:32+00:00 |
Last Scan
| Scanned | 2024-11-17T22:00:32+00:00 |
| URL | https://hipages.com.au/robots.txt |
| Domain IPs | 13.33.88.21, 13.33.88.70, 13.33.88.93, 13.33.88.98 |
| Response IP | 13.33.88.70 |
| Found | Yes |
| Hash | 7505af2e37ee7067d4e4ade2d7bed751b8fb966d56e68198989d608628b828be |
| SimHash | 0838c064a6da |
Groups
googlebot
mediapartners-google
bingbot
duckduckbot
baiduspider
botify
ahrefsbot
googleother
google-inspectiontool
googlebot-video
googlebot-image
archive.org_bot
| Rule | Path |
|---|---|
| Disallow | /brochures/* |
| Disallow | /site_search* |
| Disallow | /doubleclick_banners* |
| Disallow | /find?q=* |
| Disallow | /find/*?q=* |
| Disallow | /find*/*/postcode/* |
| Disallow | /find_mobile/* |
| Disallow | /buildingtrades/*/postcode/* |
| Disallow | /search* |
| Disallow | /js/check.referrer.cookie.php* |
| Disallow | /modules/stats/view_history.php* |
| Disallow | /modules/browse/article_js_functions.php* |
| Disallow | /creative/brochures/ |
| Disallow | /creative/brochures/*/ |
| Disallow | /creative/brochures/*/pages/ |
| Disallow | /get_quotes_serp |
| Disallow | /ios/app/ |
| Disallow | /ws/ios |
| Disallow | /ws/debug/ios |
| Disallow | /get_quotes_partners |
| Disallow | /category_hero_images |
| Disallow | /get_quotes_directory |
| Disallow | /get_quotes_simple_* |
| Disallow | /get_quotes_newsletter_* |
| Disallow | /get_quotes_iframe |
| Disallow | *get_quotes_homesales_simple |
| Disallow | /what_device |
| Disallow | /system/ajax_handlers* |
| Disallow | /*?limitno=*pageno=* |
| Disallow | /*?limit=*page=* |
| Disallow | /account/* |
| Disallow | /articles?c=article_topics&q=* |
| Disallow | /articles/page/*?c=article_topics&q=* |
| Disallow | /find/easter_bunny* |
| Disallow | /modules/stats/contact_stats.php* |
| Disallow | /user/* |
| Disallow | /email-form/* |
| Disallow | /request_quote/* |
| Disallow | /enquire/* |
| Disallow | /connect/*/recommendations |
| Disallow | /view/ |
| Disallow | /inspirationboard/ |
| Disallow | */message_centre |
| Disallow | */photos/book/add |
| Disallow | /modules/stats/* |
| Disallow | /vitek.php* |
| Disallow | /get_recommendations/* |
| Disallow | /interactive_widget_api/locations* |
| Disallow | /vouchers_placeholder* |
| Disallow | /system/ajax_handlers/* |
| Disallow | /ws/webhook/* |
| Disallow | /api/* |
| Disallow | /2fc5bdf6bf2736e1f5630e1573af5a4f |
| Disallow | /*?offer=* |
*
| Rule | Path |
|---|---|
| Disallow | / |
Comments