peekyou.com
robots.txt

Robots Exclusion Standard data for peekyou.com

Resource Scan

Scan Details

Site Domain peekyou.com
Base Domain peekyou.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-09T04:24:03+00:00
Next Scan 2026-02-07T04:24:03+00:00

Last Successful Scan

Scanned2025-09-29T08:33:03+00:00
URL https://peekyou.com/robots.txt
Redirect https://www.peekyou.com/robots.txt
Redirect Domain www.peekyou.com
Redirect Base peekyou.com
Domain IPs 172.66.41.7, 172.66.42.249, 2606:4700:3108::ac42:2907, 2606:4700:3108::ac42:2af9
Redirect IPs 172.66.41.7, 172.66.42.249, 2606:4700:3108::ac42:2907, 2606:4700:3108::ac42:2af9
Response IP 172.66.41.7
Found Yes
Hash 0ae9e0aaa865cdff1a2a7348c80529276355edb25fc4bbff3e994bbbbb29e437
SimHash ce49d6f08d73

Groups

*

Rule Path
Disallow /showprofile.php?action=get_history&id=*
Disallow /gallery.php*
Disallow /results.php
Disallow /*layout%3Dgrid*
Disallow /ext/
Disallow /track_spokeo.php
Disallow /outgoing/*
Disallow /addineyeV2.html
Disallow /DARTIframe.html
Disallow /provider/*
Disallow /web_results/*
Disallow /tools/

exabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap https://www.peekyou.com/sitemap/xml/sitemap_index.xml

Warnings

  • 2 invalid lines.