Log In Sign Up

lien.cz
robots.txt

Robots Exclusion Standard data for lien.cz

Resource Scan

Scan Details

Site Domain lien.cz
Base Domain lien.cz
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-09-09T10:53:10+00:00
Next Scan 2024-11-08T10:53:10+00:00

Last Successful Scan

Scanned2024-06-19T10:52:15+00:00
URL http://lien.cz/robots.txt
Redirect https://www.renatalien.cz/robots.txt
Redirect Domain www.renatalien.cz
Redirect Base renatalien.cz
Domain IPs 2a02:2b88:1:4::18, 46.28.105.4
Redirect IPs 34.149.87.45
Response IP 34.149.87.45
Found Yes
Hash ad7bbfcb2be92a443492ffce5a074202d04a36b7c95008a1df2d02461ce81466
SimHash 48d68a62d656

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow *?lightbox=

adsbot-google-mobile
adsbot-google

Rule Path
Disallow /_api/*
Disallow /_partials*
Disallow /pro-gallery-webapp/v1/galleries/*

petalbot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.renatalien.cz/sitemap.xml
Back to top

Comments

  • Optimization for Google Ads Bot
  • Block PetalBot
  • Crawl delay for overly enthusiastic bots
  • Auto generated, go to SEO Tools > Robots.txt Editor to change this
Back to top