fondazioneilfattoquotidiano.org
robots.txt

Robots Exclusion Standard data for fondazioneilfattoquotidiano.org

Resource Scan

Scan Details

Site Domain fondazioneilfattoquotidiano.org
Base Domain fondazioneilfattoquotidiano.org
Scan Status Ok
Last Scan2024-11-14T11:19:22+00:00
Next Scan 2024-11-21T11:19:22+00:00

Last Scan

Scanned2024-11-14T11:19:22+00:00
URL https://fondazioneilfattoquotidiano.org/robots.txt
Redirect https://www.fondazioneilfattoquotidiano.org:443/robots.txt
Redirect Domain www.fondazioneilfattoquotidiano.org
Redirect Base fondazioneilfattoquotidiano.org
Domain IPs 18.198.182.165, 35.157.230.47
Redirect IPs 3.160.196.126, 3.160.196.21, 3.160.196.36, 3.160.196.87
Response IP 18.165.140.86
Found Yes
Hash df41100e5c1b49e681fe7cc97a095da7d9af868d38cd5fd2a0a3ae202d644e57
SimHash efa8403908b1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /feed/
Disallow /risultati-di-ricerca/
Disallow /shop/
Disallow /sharing/
Disallow /*fb_xd_fragment*
Disallow /2010/10/01/tangenti-e-benefit-da-case-farmaceutiche-arrestato-a-firenze-il-professor-torello-lotti/66811/
Disallow /2013/06/14/dermatologo-lotti-condannato-ma-chiede-al-fatto-it-riabilitazione/624189/
Disallow /2011/05/29/la-guerra-alla-magistratura-delegittima-chi-la-fa/114558/amp/www.*
Disallow /2015/05/23/ex-jugoslavia-oltre-la-tribu-la-straordinaria-esperienza-del-tribunale-delle-donne/1711845/amp/www.*
Disallow /search/
Disallow /motori-2-0/annunci-auto/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

arianna

Rule Path
Disallow /

arianna news

Rule Path
Disallow /

arianna web

Rule Path
Disallow /

arianna robot

Rule Path
Disallow /

webnews arianna

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /
Allow /wp-content/uploads/