penimaster.com
robots.txt

Robots Exclusion Standard data for penimaster.com

Resource Scan

Scan Details

Site Domain penimaster.com
Base Domain penimaster.com
Scan Status Ok
Last Scan2025-11-18T08:43:21+00:00
Next Scan 2025-12-18T08:43:21+00:00

Last Scan

Scanned2025-11-18T08:43:21+00:00
URL https://penimaster.com/robots.txt
Redirect https://www.penimaster.com/robots.txt
Redirect Domain www.penimaster.com
Redirect Base penimaster.com
Domain IPs 2001:7f0:3000:512::512:156, 81.209.255.156
Redirect IPs 2001:7f0:3000:512::512:156, 81.209.255.156
Response IP 81.209.255.156
Found Yes
Hash 74d1c3a9241fa213ceb3407f8c2f9b9c63df992c778703bc9ee1c8e1d97934f3
SimHash 195458528d93

Groups

*

Rule Path
Disallow /logs/
Disallow /partner/
Disallow /*PHPSESSID*

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap /sitemap.xml