pagina12.com.ar
robots.txt

Robots Exclusion Standard data for pagina12.com.ar

Resource Scan

Scan Details

Site Domain pagina12.com.ar
Base Domain pagina12.com.ar
Scan Status Ok
Last Scan2024-06-12T06:50:51+00:00
Next Scan 2024-06-19T06:50:51+00:00

Last Scan

Scanned2024-06-12T06:50:51+00:00
URL https://pagina12.com.ar/robots.txt
Redirect https://www.pagina12.com.ar/robots.txt
Redirect Domain www.pagina12.com.ar
Redirect Base pagina12.com.ar
Domain IPs 104.22.70.126, 104.22.71.126, 172.67.41.55
Redirect IPs 104.22.70.126, 104.22.71.126, 172.67.41.55
Response IP 172.67.41.55
Found Yes
Hash e4fcb5573509a3adf284ae23240a59cff310db22f94aa67185ae004cc34427da
SimHash e981d9051dd7

Groups

*

Rule Path
Disallow /logout-user?redirect=*
Disallow /349353471/
Disallow /admin/
Disallow /andytow/
Disallow /apps/talk
Disallow /apps/zar

Other Records

Field Value
sitemap https://www.pagina12.com.ar/sitemap.xml.gz
sitemap https://www.pagina12.com.ar/breakingnews.xml
sitemap https://www.pagina12.com.ar/breakingnews-short.xml

Comments

  • robots.txt for https://www.pagina12.com.ar/