femalenetwork.com
robots.txt

Robots Exclusion Standard data for femalenetwork.com

Resource Scan

Scan Details

Site Domain femalenetwork.com
Base Domain femalenetwork.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-17T06:01:08+00:00
Next Scan 2024-11-16T06:01:08+00:00

Last Successful Scan

Scanned2024-08-01T00:43:29+00:00
URL https://femalenetwork.com/robots.txt
Redirect https://www.femalenetwork.com/robots.txt
Redirect Domain www.femalenetwork.com
Redirect Base femalenetwork.com
Domain IPs 104.18.14.124, 104.18.15.124, 2606:4700::6812:e7c, 2606:4700::6812:f7c
Redirect IPs 104.18.14.124, 104.18.15.124, 2606:4700::6812:e7c, 2606:4700::6812:f7c
Response IP 104.18.15.124
Found Yes
Hash 3863569ad87a4fe33def68e21965d39c98ff519590ca7cbdd2f8ccde4b199bc6
SimHash 5e264a6ce931

Groups

*

Rule Path
Disallow /admin
Disallow /app
Disallow /backups
Disallow /bootstrap
Disallow /conf
Disallow /vendor
Disallow /json
Disallow /api
Disallow /lib/captcha/img.php
Disallow /girltalk/index.php?action=help*
Disallow /girltalk/index.php?action=login*
Disallow /girltalk/index.php?action=register*
Disallow /girltalk/index.php?action=search*
Disallow /girltalk/index.php?action=reminder*
Disallow /girltalk/index.php?action=profile*
Disallow /girltalk/index.php?action=unread*
Disallow /girltalk/index.php?action=verificationcode*
Disallow /girltalk/index.php?action=printpage*
Disallow /girltalk/index.php?*%3Bwap
Disallow /girltalk/index.php?*%3Bwap2
Disallow /girltalk/index.php?*%3Bimode

mediapartners-google
twitterbot
grapeshot

Rule Path
Disallow

yandexbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.femalenetwork.com/sitemap.xml