thespiritofdubai.com
robots.txt
Robots Exclusion Standard data for thespiritofdubai.com
Resource Scan
Scan Details
| Site Domain | thespiritofdubai.com |
| Base Domain | thespiritofdubai.com |
| Scan Status | Ok |
| Last Scan | 2024-06-10T21:39:44+00:00 |
| Next Scan | 2024-07-10T21:39:44+00:00 |
Last Scan
| Scanned | 2024-06-10T21:39:44+00:00 |
| URL | https://thespiritofdubai.com/robots.txt |
| Redirect | https://www.thespiritofdubai.com/robots.txt |
| Redirect Domain | www.thespiritofdubai.com |
| Redirect Base | thespiritofdubai.com |
| Domain IPs | 194.76.17.20 |
| Redirect IPs | 194.76.17.20 |
| Response IP | 194.76.17.20 |
| Found | Yes |
| Hash | 23c2380dee516f5ff6c2b206160514fdc347c74cc9bc3a6f10bb9ab19efa6766 |
| SimHash | 6001d1a0e191 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /beta/ |
| Disallow | /http%3A//thespiritofdubai.com/beta/ |
| Disallow | /v1/ |
| Disallow | /http%3A//thespiritofdubai.com/v1/ |
| Disallow | /Old-Site-190515/ |
| Disallow | /http%3A//thespiritofdubai.com/Old-Site-190515/ |
| Disallow | /testsiteold/ |
| Disallow | /http%3A//thespiritofdubai.com/testsiteold/ |
| Disallow | /testsite/ |
| Disallow | /http%3A//thespiritofdubai.com/testsite/ |
| Disallow | /personalform/ |
| Disallow | /http%3A//thespiritofdubai.com/personalform/ |
| Disallow | /customerform/ |
| Disallow | /http%3A//thespiritofdubai.com/customerform/ |