rentler.com
robots.txt
Robots Exclusion Standard data for rentler.com
Resource Scan
Scan Details
Site Domain | rentler.com |
Base Domain | rentler.com |
Scan Status | Ok |
Last Scan | 2024-09-24T10:25:22+00:00 |
Next Scan | 2024-10-24T10:25:22+00:00 |
Last Scan
Scanned | 2024-09-24T10:25:22+00:00 |
URL | https://rentler.com/robots.txt |
Redirect | https://www.rentler.com/robots.txt |
Redirect Domain | www.rentler.com |
Redirect Base | rentler.com |
Domain IPs | 104.26.12.71, 104.26.13.71, 172.67.69.16, 2606:4700:20::681a:c47, 2606:4700:20::681a:d47, 2606:4700:20::ac43:4510 |
Redirect IPs | 104.26.12.71, 104.26.13.71, 172.67.69.16, 2606:4700:20::681a:c47, 2606:4700:20::681a:d47, 2606:4700:20::ac43:4510 |
Response IP | 104.26.12.71 |
Found | Yes |
Hash | 938d02a8826e7fa5b8fde6a60560573f3dc7017337956f31afe8a6bc0d74fb75 |
SimHash | 05045814c911 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /api/ |
Disallow | /bin/ |
Disallow | /ksl/ |
Disallow | /account/ |
Disallow | /places-for-rent/account/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rentler.com/sitemap.xml.gz |