Log In Sign Up

komerestaurant.it
robots.txt

Robots Exclusion Standard data for komerestaurant.it

Resource Scan

Scan Details

Site Domain komerestaurant.it
Base Domain komerestaurant.it
Scan Status Ok
Last Scan2026-02-07T03:48:10+00:00
Next Scan 2026-03-09T03:48:10+00:00

Last Scan

Scanned2026-02-07T03:48:10+00:00
URL https://komerestaurant.it/robots.txt
Domain IPs 80.88.87.123
Response IP 80.88.87.123
Found Yes
Hash 1f217fde099c1c7c38019933bb065b9cdebd70bda8441145c851bd574baccdc4
SimHash e61dcc93e0fb

Groups

domaincrawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

googlebot-image

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /*.jpg
Disallow /*.JPG
Disallow /*.png
Disallow /*.PDF
Disallow /*.pdf
Disallow /*.mp3
Disallow /*.MOV
Disallow /*.mov
Disallow /*.AVI
Disallow /*.avi
Disallow /*.csv
Disallow /*.data
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 5
Back to top

Other Records

Field Value
sitemap https://www.komerestaurant.it/sitemap_index.xml
sitemap https://www.komerestaurant.it/page-sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top