lesbiandatingsite.net
robots.txt
Robots Exclusion Standard data for lesbiandatingsite.net
Resource Scan
Scan Details
| Site Domain | lesbiandatingsite.net |
| Base Domain | lesbiandatingsite.net |
| Scan Status | Ok |
| Last Scan | 2024-11-14T14:07:37+00:00 |
| Next Scan | 2024-12-14T14:07:37+00:00 |
Last Scan
| Scanned | 2024-11-14T14:07:37+00:00 |
| URL | https://lesbiandatingsite.net/robots.txt |
| Redirect | https://www.lesbiemates.com/robots.txt |
| Redirect Domain | www.lesbiemates.com |
| Redirect Base | lesbiemates.com |
| Domain IPs | 104.21.73.176, 172.67.191.20, 2606:4700:3034::ac43:bf14, 2606:4700:3035::6815:49b0 |
| Redirect IPs | 23.209.46.150, 23.209.46.162, 2600:1413:b000:1c::17d1:2ec7, 2600:1413:b000:1c::17d1:2ed6 |
| Response IP | 104.88.71.8 |
| Found | Yes |
| Hash | 00c192eeec3dca918fa374f4d7cd9e0ea441a252667ea9dfdac5978e41845405 |
| SimHash | 38554c40c553 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *autologin* |
*
| Rule | Path |
|---|---|
| Disallow | /landing/mta |
| Disallow | /t/tr |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lesbiemates.com/sitemap.xml |