remax.co.za
robots.txt
Robots Exclusion Standard data for remax.co.za
Resource Scan
Scan Details
| Site Domain | remax.co.za |
| Base Domain | remax.co.za |
| Scan Status | Ok |
| Last Scan | 2024-10-20T17:56:03+00:00 |
| Next Scan | 2024-11-19T17:56:03+00:00 |
Last Scan
| Scanned | 2024-10-20T17:56:03+00:00 |
| URL | https://remax.co.za/robots.txt |
| Redirect | https://www.remax.co.za:443/robots.txt |
| Redirect Domain | www.remax.co.za |
| Redirect Base | remax.co.za |
| Domain IPs | 3.248.174.26, 54.195.115.236, 54.76.39.251 |
| Redirect IPs | 3.248.174.26, 54.195.115.236, 54.76.39.251 |
| Response IP | 3.248.174.26 |
| Found | Yes |
| Hash | d96f5bf9fcd64a7abfd8d22b824a2865d27914347fe142e83b690ad125f86b21 |
| SimHash | 6a1dd3d266b5 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /listing/fetchcitywithsuburb/ |
| Disallow | /lead/listing_message/ |
| Disallow | /fetch/propertytypes/ |
| Disallow | /lead/click/clicks_show_phone/ |
| Disallow | /lead/rent_home/ |
| Disallow | /lead/franchise/ |
| Disallow | /lead/join/ |
| Disallow | /lead/sell_home/ |
| Disallow | /property/url_stub/ |
| Disallow | /fetch/officebyprovince/ |
| Disallow | /nearby/for-sale/ |
| Disallow | /fetch/propertytypes/ |
| Disallow | /forex/convert/* |
| Disallow | /world-long-drive/* |
| Disallow | /print/* |
| Disallow | /create-pdf/* |
| Disallow | /*.pdf$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.remax.co.za/sitemap.xml |