prepagos69.com
robots.txt

Robots Exclusion Standard data for prepagos69.com

Resource Scan

Scan Details

Site Domain prepagos69.com
Base Domain prepagos69.com
Scan Status Ok
Last Scan2025-09-27T01:01:41+00:00
Next Scan 2025-10-27T01:01:41+00:00

Last Scan

Scanned2025-09-27T01:01:41+00:00
URL https://prepagos69.com/robots.txt
Domain IPs 104.21.69.131, 172.67.208.183, 2606:4700:3034::6815:4583, 2606:4700:3035::ac43:d0b7
Response IP 172.67.208.183
Found Yes
Hash 93a6bcebcc0424cde1b86e256fa7d24b5733a729430d98ed3233b8a173bbe8d8
SimHash 41344054c340

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

googlebot
*

Rule Path
Disallow /terms/
Disallow /sobre-nosotras/
Disallow /privacyPolicy/

Warnings

  • `visit-time` is not a known field.