en.girlstop.info
robots.txt

Robots Exclusion Standard data for en.girlstop.info

Resource Scan

Scan Details

Site Domain en.girlstop.info
Base Domain girlstop.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-01T08:58:52+00:00
Next Scan 2025-05-31T08:58:52+00:00

Last Successful Scan

Scanned2025-01-09T08:57:42+00:00
URL https://en.girlstop.info/robots.txt
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1
Response IP 104.21.64.1
Found Yes
Hash 38154968efd1af0b4847f632d9330dcf3e89f79a7ef75c6bc7f97b2b46c96f8e
SimHash 1034c8724603

Groups

seekportbot
baiduspider
dotbot
awariorssbot
awariosmartbot
pimeyesbot
pimeyes.com crawler
semrushbot
archive.org_bot
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /index.php$
Disallow /search.php
Disallow /user.php
Disallow /gallery.php
Disallow *sort%3D
Disallow *page%3D
Disallow *date
Disallow *ysclid
Disallow /puzzle.php?solve
Allow /

Warnings

  • `clean-param` is not a known field.