comune.nola.na.it
robots.txt

Robots Exclusion Standard data for comune.nola.na.it

Resource Scan

Scan Details

Site Domain comune.nola.na.it
Base Domain nola.na.it
Scan Status Ok
Last Scan2024-09-27T19:27:49+00:00
Next Scan 2024-10-27T19:27:49+00:00

Last Scan

Scanned2024-09-27T19:27:49+00:00
URL https://comune.nola.na.it/robots.txt
Domain IPs 185.199.48.101
Response IP 185.199.48.101
Found Yes
Hash dc1dbe14168d35421e08270b51bafcddb7e9a1b33e7fa5dd90017a820c556a7e
SimHash 2801d5c156f7

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

googlebot-image

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

mediapartners-google

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

bingbot

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

msnbot

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

msnbot-media

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

yahoo-blogs

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

yahoo-mmcrawler

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

facebookexternalhit

Rule Path
Disallow /de/
Disallow /mc/
Disallow /images/
Disallow /*/de/*
Disallow /*/mc/*
Disallow /*/images/*

Other Records

Field Value
crawl-delay 600

Comments

  • but allow only important bots