penweb.info
robots.txt

Robots Exclusion Standard data for penweb.info

Resource Scan

Scan Details

Site Domain penweb.info
Base Domain penweb.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-12T17:14:48+00:00
Next Scan 2026-01-10T17:14:48+00:00

Last Successful Scan

Scanned2025-06-15T16:43:45+00:00
URL https://penweb.info/robots.txt
Domain IPs 183.90.181.102
Response IP 183.90.181.102
Found Yes
Hash c8534f6c24983b111bcf59cfe0a7e6640d3dd37906669eaa150984985eb3bcaf
SimHash 690188408bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://penweb.info/sitemap.xml
sitemap https://penweb.info/sitemap.rss
sitemap https://penweb.info/sitemap.xml