rentmasseur.com
robots.txt
Robots Exclusion Standard data for rentmasseur.com
Resource Scan
Scan Details
| Site Domain | rentmasseur.com |
| Base Domain | rentmasseur.com |
| Scan Status | Ok |
| Last Scan | 2024-05-01T04:16:45+00:00 |
| Next Scan | 2024-05-31T04:16:45+00:00 |
Last Scan
| Scanned | 2024-05-01T04:16:45+00:00 |
| URL | https://rentmasseur.com/robots.txt |
| Domain IPs | 104.26.8.170, 104.26.9.170, 172.67.70.18, 2606:4700:20::681a:8aa, 2606:4700:20::681a:9aa, 2606:4700:20::ac43:4612 |
| Response IP | 104.26.8.170 |
| Found | Yes |
| Hash | 4657940b5cb76550d82330bf10d67363d01823b435fea19b568a68f2b2e599e2 |
| SimHash | 4f01d161e133 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /register |
| Disallow | /login |
| Disallow | /about/terms |
| Disallow | /about/contact |
| Disallow | /massage-reviews/submit/ |
| Disallow | /*/ajax |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rentmasseur.com/xml/sitemap/profiles |
| sitemap | https://rentmasseur.com/xml/sitemap/locations |