puglianotizie.it
robots.txt

Robots Exclusion Standard data for puglianotizie.it

Resource Scan

Scan Details

Site Domain puglianotizie.it
Base Domain puglianotizie.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-05-03T23:34:39+00:00
Next Scan 2024-07-02T23:34:39+00:00

Last Successful Scan

Scanned2024-03-05T22:39:55+00:00
URL http://puglianotizie.it/robots.txt
Domain IPs 75.119.147.23
Response IP 75.119.147.23
Found Yes
Hash a8938c122a831cadaa300dca5c8f2bebd1eca6a018fb75be6d8259dde837c159
SimHash 481c9d606f93

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.puglianotizie.it/?feed=xmlsitemap41