femalenetwork.com
robots.txt
Robots Exclusion Standard data for femalenetwork.com
Resource Scan
Scan Details
Site Domain | femalenetwork.com |
Base Domain | femalenetwork.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-17T06:01:08+00:00 |
Next Scan | 2024-11-16T06:01:08+00:00 |
Last Successful Scan
Scanned | 2024-08-01T00:43:29+00:00 |
URL | https://femalenetwork.com/robots.txt |
Redirect | https://www.femalenetwork.com/robots.txt |
Redirect Domain | www.femalenetwork.com |
Redirect Base | femalenetwork.com |
Domain IPs | 104.18.14.124, 104.18.15.124, 2606:4700::6812:e7c, 2606:4700::6812:f7c |
Redirect IPs | 104.18.14.124, 104.18.15.124, 2606:4700::6812:e7c, 2606:4700::6812:f7c |
Response IP | 104.18.15.124 |
Found | Yes |
Hash | 3863569ad87a4fe33def68e21965d39c98ff519590ca7cbdd2f8ccde4b199bc6 |
SimHash | 5e264a6ce931 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin |
Disallow | /app |
Disallow | /backups |
Disallow | /bootstrap |
Disallow | /conf |
Disallow | /vendor |
Disallow | /json |
Disallow | /api |
Disallow | /lib/captcha/img.php |
Disallow | /girltalk/index.php?action=help* |
Disallow | /girltalk/index.php?action=login* |
Disallow | /girltalk/index.php?action=register* |
Disallow | /girltalk/index.php?action=search* |
Disallow | /girltalk/index.php?action=reminder* |
Disallow | /girltalk/index.php?action=profile* |
Disallow | /girltalk/index.php?action=unread* |
Disallow | /girltalk/index.php?action=verificationcode* |
Disallow | /girltalk/index.php?action=printpage* |
Disallow | /girltalk/index.php?*%3Bwap |
Disallow | /girltalk/index.php?*%3Bwap2 |
Disallow | /girltalk/index.php?*%3Bimode |
Other Records
Field | Value |
---|---|
sitemap | https://www.femalenetwork.com/sitemap.xml |