lesbiemates.com
robots.txt
Robots Exclusion Standard data for lesbiemates.com
Resource Scan
Scan Details
| Site Domain | lesbiemates.com |
| Base Domain | lesbiemates.com |
| Scan Status | Ok |
| Last Scan | 2024-11-06T17:43:01+00:00 |
| Next Scan | 2024-12-06T17:43:01+00:00 |
Last Scan
| Scanned | 2024-11-06T17:43:01+00:00 |
| URL | https://lesbiemates.com/robots.txt |
| Redirect | https://www.lesbiemates.com/robots.txt |
| Redirect Domain | www.lesbiemates.com |
| Redirect Base | lesbiemates.com |
| Domain IPs | 104.131.213.144, 138.68.216.177 |
| Redirect IPs | 23.215.7.18, 23.215.7.8, 2600:1413:b000:1b::17d7:708, 2600:1413:b000:1b::17d7:712 |
| Response IP | 23.32.29.11 |
| Found | Yes |
| Hash | 00c192eeec3dca918fa374f4d7cd9e0ea441a252667ea9dfdac5978e41845405 |
| SimHash | 38554c40c553 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *autologin* |
*
| Rule | Path |
|---|---|
| Disallow | /landing/mta |
| Disallow | /t/tr |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lesbiemates.com/sitemap.xml |