harianpijar.com
robots.txt

Robots Exclusion Standard data for harianpijar.com

Resource Scan

Scan Details

Site Domain harianpijar.com
Base Domain harianpijar.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-16T12:45:10+00:00
Next Scan 2025-02-14T12:45:10+00:00

Last Successful Scan

Scanned2024-07-20T10:14:51+00:00
URL https://harianpijar.com/robots.txt
Domain IPs 104.21.11.60, 172.67.191.90, 2606:4700:3031::6815:b3c, 2606:4700:3031::ac43:bf5a
Response IP 172.67.191.90
Found Yes
Hash 47ffa56d9684240f2fd9f1582eb9aa5cb90452702ccfa037a775615d22a20285
SimHash e9085260c7b3

Groups

*

Rule Path
Disallow /cgi-bin/
Allow /

Other Records

Field Value
sitemap https://www.harianpijar.com/sitemap.xml
sitemap https://www.harianpijar.com/sitemap-news.xml