m.flirt.com
robots.txt

Robots Exclusion Standard data for m.flirt.com

Resource Scan

Scan Details

Site Domain m.flirt.com
Base Domain flirt.com
Scan Status Ok
Last Scan2024-10-18T23:53:26+00:00
Next Scan 2024-11-17T23:53:26+00:00

Last Scan

Scanned2024-10-18T23:53:26+00:00
URL https://m.flirt.com/robots.txt
Redirect https://www.flirt.com/robots.txt
Redirect Domain www.flirt.com
Redirect Base flirt.com
Domain IPs 23.32.29.17, 2600:1413:1::1720:1d11, 2600:1413:1::6011:b432, 96.17.180.50
Redirect IPs 23.215.7.15, 23.215.7.26, 2600:1413:1::1720:1d11, 2600:1413:1::6011:b432
Response IP 96.17.180.24
Found Yes
Hash 43b68a7a0ff83f8aca2f01e04a257768552fbe9d1cbb586bd74ded52977e7754
SimHash 781cc8c049e2

Groups

*

Rule Path
Disallow /dating/uk/*
Disallow /dating/usa/*
Disallow /dating/ca/*
Disallow /dating/au/*
Disallow /login.php*
Disallow /nu1.asp
Disallow /help.php*
Disallow /vcard/*

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

*

Rule Path
Disallow /landing/mta
Disallow /t/tr

Other Records

Field Value
sitemap https://www.flirt.com/sitemap.xml