lesbiemates.com
robots.txt
Robots Exclusion Standard data for lesbiemates.com
Resource Scan
Scan Details
| Site Domain | lesbiemates.com |
| Base Domain | lesbiemates.com |
| Scan Status | Ok |
| Last Scan | 2024-04-18T17:40:50+00:00 |
| Next Scan | 2024-05-18T17:40:50+00:00 |
Last Scan
| Scanned | 2024-04-18T17:40:50+00:00 |
| URL | https://lesbiemates.com/robots.txt |
| Redirect | https://www.lesbiemates.com/robots.txt |
| Redirect Domain | www.lesbiemates.com |
| Redirect Base | lesbiemates.com |
| Domain IPs | 104.131.213.144, 138.68.216.177 |
| Redirect IPs | 23.52.171.208, 23.59.168.162, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:712 |
| Response IP | 96.17.180.33 |
| Found | Yes |
| Hash | 00c192eeec3dca918fa374f4d7cd9e0ea441a252667ea9dfdac5978e41845405 |
| SimHash | 38554c40c553 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *autologin* |
*
| Rule | Path |
|---|---|
| Disallow | /landing/mta |
| Disallow | /t/tr |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lesbiemates.com/sitemap.xml |