kniznica-rv.sk
robots.txt

Robots Exclusion Standard data for kniznica-rv.sk

Resource Scan

Scan Details

Site Domain kniznica-rv.sk
Base Domain kniznica-rv.sk
Scan Status Ok
Last Scan2025-10-04T20:23:31+00:00
Next Scan 2025-11-03T20:23:31+00:00

Last Scan

Scanned2025-10-04T20:23:31+00:00
URL https://kniznica-rv.sk/robots.txt
Redirect http://www.kniznica-rv.sk/robots.txt
Redirect Domain www.kniznica-rv.sk
Redirect Base kniznica-rv.sk
Domain IPs 2a0e:acc0::c33, 2a0e:acc0::c34, 45.138.107.33, 45.138.107.34
Redirect IPs 2a0e:acc0::c33, 2a0e:acc0::c34, 45.138.107.33, 45.138.107.34
Response IP 45.138.107.33
Found Yes
Hash 344b3685e99b215a4f7b017467104fbb911007e8f2d15daedb0334f5292f5b8c
SimHash b8129d1bc574

Groups

mozilla/5.0 (compatible; ht/3.4.0-* +https://www.webdepozit.sk/)

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.kniznica-rv.sk/sitemap.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html