agimeg.it
robots.txt

Robots Exclusion Standard data for agimeg.it

Resource Scan

Scan Details

Site Domain agimeg.it
Base Domain agimeg.it
Scan Status Ok
Last Scan2024-11-11T13:18:13+00:00
Next Scan 2024-11-18T13:18:13+00:00

Last Scan

Scanned2024-11-11T13:18:13+00:00
URL https://agimeg.it/robots.txt
Redirect https://www.agimeg.it/robots.txt
Redirect Domain www.agimeg.it
Redirect Base agimeg.it
Domain IPs 104.26.10.10, 104.26.11.10, 172.67.69.17, 2606:4700:20::681a:a0a, 2606:4700:20::681a:b0a, 2606:4700:20::ac43:4511
Redirect IPs 104.26.10.10, 104.26.11.10, 172.67.69.17, 2606:4700:20::681a:a0a, 2606:4700:20::681a:b0a, 2606:4700:20::ac43:4511
Response IP 104.26.10.10
Found Yes
Hash 8abc9cafe28629ad73e13f13eb77dc406ed660e00c13c44bddaca78b25ee2c14
SimHash 49001c0289b3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /
Disallow /adnkronos/
Disallow /page/
Disallow /category/repubblica/
Disallow /category/speciali/
Disallow /category/sportmediaset/
Disallow /category/tgcom/
Disallow /*.pdf

Other Records

Field Value
sitemap https://www.agimeg.it/news-sitemap.xml
sitemap https://www.agimeg.it/sitemap.xml
sitemap https://www.agimeg.it/sitemap.rss