folhapop.com.br
robots.txt

Robots Exclusion Standard data for folhapop.com.br

Resource Scan

Scan Details

Site Domain folhapop.com.br
Base Domain folhapop.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-30T08:47:55+00:00
Next Scan 2024-09-29T08:47:55+00:00

Last Successful Scan

Scanned2024-08-01T08:22:01+00:00
URL https://folhapop.com.br/robots.txt
Redirect https://www.folhapop.com.br/robots.txt
Redirect Domain www.folhapop.com.br
Redirect Base folhapop.com.br
Domain IPs 5.196.92.66
Redirect IPs 5.196.92.66
Response IP 5.196.92.66
Found Yes
Hash 75b382235b1cfb79a9ea15bef7a90d2a08cc1851576de80197393931586e0dde
SimHash 69090864c293

Groups

*

Rule Path
Allow /
Disallow /cgi-bin/
Disallow /admin/

Other Records

Field Value
sitemap https://www.folhapop.com.br/sitemap.xml