theglenshopping.co.za
robots.txt
Robots Exclusion Standard data for theglenshopping.co.za
Resource Scan
Scan Details
| Site Domain | theglenshopping.co.za |
| Base Domain | theglenshopping.co.za |
| Scan Status | Ok |
| Last Scan | 2024-11-15T05:44:58+00:00 |
| Next Scan | 2024-12-15T05:44:58+00:00 |
Last Scan
| Scanned | 2024-11-15T05:44:58+00:00 |
| URL | https://theglenshopping.co.za/robots.txt |
| Domain IPs | 13.33.88.26, 13.33.88.36, 13.33.88.42, 13.33.88.77, 2600:9000:223b:1400:7:8259:6a80:93a1, 2600:9000:223b:3e00:7:8259:6a80:93a1, 2600:9000:223b:4600:7:8259:6a80:93a1, 2600:9000:223b:6c00:7:8259:6a80:93a1, 2600:9000:223b:7200:7:8259:6a80:93a1, 2600:9000:223b:8000:7:8259:6a80:93a1, 2600:9000:223b:9000:7:8259:6a80:93a1, 2600:9000:223b:d200:7:8259:6a80:93a1 |
| Response IP | 13.33.88.26 |
| Found | Yes |
| Hash | e473dd83d9c3ad88bc44512e129e08682ff5626a55838c2f9e8ee2f9c9d587a2 |
| SimHash | 14c48d414754 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /auth/* |
| Disallow | /profile |
Other Records
| Field | Value |
|---|---|
| sitemap | https://theglenshopping.co.za/sitemap/c9ba5816-86fe-41a8-ae04-81b422e9e998.xml |
Comments