youporn.expert
robots.txt

Robots Exclusion Standard data for youporn.expert

Resource Scan

Scan Details

Site Domain youporn.expert
Base Domain youporn.expert
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2/15/2025, 2:53:11 PM
Next Scan 4/16/2025, 2:53:11 PM

Last Successful Scan

Scanned11/25/2024, 1:29:24 PM
URL https://youporn.expert/robots.txt
Domain IPs 104.21.40.105, 172.67.185.134, 2606:4700:3033::6815:2869, 2606:4700:3034::ac43:b986
Response IP 172.67.185.134
Found Yes
Hash 9b67aee000a18a73380aae5cb7ae57ab7548cd98c1f643740425a42f5c31dd7a
SimHash 4f010e40c3b5

Groups

yandex

Rule Path
Disallow /geo/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /geo/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /geo/*

Other Records

Field Value
sitemap https://youporn.expert/sitemap.xml

Warnings

  • `host` is not a known field.