infonotizia.it
robots.txt

Robots Exclusion Standard data for infonotizia.it

Resource Scan

Scan Details

Site Domain infonotizia.it
Base Domain infonotizia.it
Scan Status Ok
Last Scan2024-11-12T03:49:22+00:00
Next Scan 2024-11-19T03:49:22+00:00

Last Scan

Scanned2024-11-12T03:49:22+00:00
URL https://infonotizia.it/robots.txt
Domain IPs 46.252.150.77
Response IP 46.252.150.77
Found Yes
Hash dc2505733e072007debac1cfdb245e80c894802491e4a939eb2c41aa101f0c8b
SimHash 270d1455f1b7

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.infonotizia.it/sitemap_index.xml
sitemap https://www.infonotizia.it/post-sitemap1.xml
sitemap https://www.infonotizia.it/post-sitemap2.xml
sitemap https://www.infonotizia.it/page-sitemap.xml
sitemap https://www.infonotizia.it/category-sitemap.xml

Comments

  • Simple Robots.txt 0.1