dubaiescortstars.com
robots.txt
Robots Exclusion Standard data for dubaiescortstars.com
Resource Scan
Scan Details
| Site Domain | dubaiescortstars.com |
| Base Domain | dubaiescortstars.com |
| Scan Status | Ok |
| Last Scan | 2025-05-10T20:29:27+00:00 |
| Next Scan | 2025-06-09T20:29:27+00:00 |
Last Scan
| Scanned | 2025-05-10T20:29:27+00:00 |
| URL | https://dubaiescortstars.com/robots.txt |
| Domain IPs | 104.21.33.232, 172.67.193.158, 2606:4700:3033::6815:21e8, 2606:4700:3034::ac43:c19e |
| Response IP | 172.67.193.158 |
| Found | Yes |
| Hash | b7d55fa7342f27c6ae83792d2580b9c6de64942a1e2d05250c21f76f4c8888ed |
| SimHash | d060530b0b17 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /js/aes.js |
| Disallow | /stories/index/?data_time= |
| Disallow | /stories/recent/?data_time= |
| Disallow | /en/stories/index/?data_time= |
| Disallow | /en/stories/recent/?data_time= |
| Disallow | /de/stories/index/?data_time= |
| Disallow | /de/stories/recent/?data_time= |
| Disallow | /es/stories/index/?data_time= |
| Disallow | /es/stories/recent/?data_time= |
| Disallow | /fr/stories/index/?data_time= |
| Disallow | /fr/stories/recent/?data_time= |
| Disallow | /it/stories/index/?data_time= |
| Disallow | /it/stories/recent/?data_time= |