quotidianodipalermo.it
robots.txt

Robots Exclusion Standard data for quotidianodipalermo.it

Resource Scan

Scan Details

Site Domain quotidianodipalermo.it
Base Domain quotidianodipalermo.it
Scan Status Ok
Last Scan2024-11-15T23:39:27+00:00
Next Scan 2024-11-22T23:39:27+00:00

Last Scan

Scanned2024-11-15T23:39:27+00:00
URL https://quotidianodipalermo.it/robots.txt
Domain IPs 45.140.185.161
Response IP 45.140.185.161
Found Yes
Hash 66a2c2a13655564a44b3aa62112ad484bccd6377d2cdfc92c7e00e89f74ae27c
SimHash ca289c600aa3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /tag
Disallow /cgi-bin
Allow /wp-admin/admin-ajax.php
Disallow

psbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

npbot-1/2.0

Rule Path
Disallow /

npbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://quotidianodipalermo.it/sitemap_index.xml