perfil.com.ar
robots.txt

Robots Exclusion Standard data for perfil.com.ar

Resource Scan

Scan Details

Site Domain perfil.com.ar
Base Domain perfil.com.ar
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-18T12:15:05+00:00
Next Scan 2024-06-16T12:15:05+00:00

Last Successful Scan

Scanned2022-11-19T02:34:19+00:00
URL http://perfil.com.ar/robots.txt
Redirect https://www.perfil.com/robots.txt
Redirect Domain www.perfil.com
Redirect Base perfil.com
Response IP 104.26.13.133, 172.67.70.40, 104.26.12.133
Found Yes
Hash 3c178fa5759183b2a1869452073a2ec589c60fffdead5522e1c68ef9a5cb55c4
SimHash c10ce856a613

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.perfil.com/sitemap
sitemap https://www.perfil.com/sitemap/lastposts
sitemap https://www.perfil.com/sitemap/google-news-lastposts
sitemap https://www.perfil.com/sitemap/videos
sitemap https://www.perfil.com/sitemap/archive

Warnings

  • `request-rate` is not a known field.