pgdragon.to
robots.txt

Robots Exclusion Standard data for pgdragon.to

Resource Scan

Scan Details

Site Domain pgdragon.to
Base Domain pgdragon.to
Scan Status Ok
Last Scan2025-10-28T19:26:23+00:00
Next Scan 2025-11-27T19:26:23+00:00

Last Scan

Scanned2025-10-28T19:26:23+00:00
URL https://pgdragon.to/robots.txt
Redirect https://www.webyoung.com/robots.txt
Redirect Domain www.webyoung.com
Redirect Base webyoung.com
Domain IPs 104.21.67.74, 172.67.217.132, 2606:4700:3033::ac43:d984, 2606:4700:3036::6815:434a
Redirect IPs 104.25.68.18, 104.25.69.18
Response IP 104.25.69.18
Found Yes
Hash b98e56610dedc116c25abfff72a2c49d1b70873e037bf4f6e57d79992d7a1123
SimHash 69049048e993

Groups

*

Rule Path
Disallow /ratings/actor*
Disallow /media/signPhotoset*
Disallow /comment/actor*

Other Records

Field Value
sitemap https://www.webyoung.com/sitemap/main.xml
sitemap https://www.webyoung.com/sitemap/actor.xml
sitemap https://www.webyoung.com/sitemap/scene.xml
sitemap https://www.webyoung.com/sitemap/photoset-1.xml
sitemap https://www.webyoung.com/sitemap/photoset-2.xml
sitemap https://xmlsitemap.webyoung.com/webyoung_20220315.xml