flirt.com
robots.txt
Robots Exclusion Standard data for flirt.com
Resource Scan
Scan Details
| Site Domain | flirt.com |
| Base Domain | flirt.com |
| Scan Status | Ok |
| Last Scan | 2024-10-18T21:44:14+00:00 |
| Next Scan | 2024-11-17T21:44:14+00:00 |
Last Scan
| Scanned | 2024-10-18T21:44:14+00:00 |
| URL | https://flirt.com/robots.txt |
| Redirect | https://www.flirt.com/robots.txt |
| Redirect Domain | www.flirt.com |
| Redirect Base | flirt.com |
| Domain IPs | 167.71.245.44, 64.225.127.226 |
| Redirect IPs | 23.215.7.15, 23.215.7.26, 2600:1413:b000:1b::17d7:70f, 2600:1413:b000:1b::17d7:71a |
| Response IP | 96.17.180.24 |
| Found | Yes |
| Hash | 43b68a7a0ff83f8aca2f01e04a257768552fbe9d1cbb586bd74ded52977e7754 |
| SimHash | 781cc8c049e2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /dating/uk/* |
| Disallow | /dating/usa/* |
| Disallow | /dating/ca/* |
| Disallow | /dating/au/* |
| Disallow | /login.php* |
| Disallow | /nu1.asp |
| Disallow | /help.php* |
| Disallow | /vcard/* |
*
| Rule | Path |
|---|---|
| Disallow | /landing/mta |
| Disallow | /t/tr |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.flirt.com/sitemap.xml |