krtgradbenistvo.si
robots.txt

Robots Exclusion Standard data for krtgradbenistvo.si

Resource Scan

Scan Details

Site Domain krtgradbenistvo.si
Base Domain krtgradbenistvo.si
Scan Status Ok
Last Scan2024-11-16T22:00:46+00:00
Next Scan 2024-12-16T22:00:46+00:00

Last Scan

Scanned2024-11-16T22:00:46+00:00
URL https://krtgradbenistvo.si/robots.txt
Domain IPs 193.77.224.191
Response IP 193.77.224.191
Found Yes
Hash 5c045af4f25768933f58862f9554af3a5edb0092028777bdb1fdd665978062cb
SimHash 4f45d3f5c795

Groups

*

Rule Path
Disallow /

apis-google
mediapartners-google
adsbot-google-mobile
adsbot-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google-mobile-apps
feedfetcher-google
bingbot
msnbot
msnbot-media
adidxbot
bingpreview
slurp
duckduckbot
baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-news
baiduspider-video
baiduspider-image
yandexbot
facebot
facebookexternalhit/1.0
facebookexternalhit/1.1
ia_archiver
archive.org_bot

Rule Path
Allow /

apis-google
mediapartners-google
adsbot-google-mobile
adsbot-google
googlebot
googlebot-image
googlebot-news
googlebot-video
adsbot-google-mobile-apps
feedfetcher-google
bingbot
msnbot
msnbot-media
adidxbot
bingpreview
slurp
duckduckbot
baiduspider
baiduspider-ads
baiduspider-cpro
baiduspider-favo
baiduspider-news
baiduspider-video
baiduspider-image
yandexbot
facebot
facebookexternalhit/1.0
facebookexternalhit/1.1
ia_archiver
archive.org_bot

Rule Path
Disallow /cms/

Other Records

Field Value
sitemap https://krtgradbenistvo.si/sitemap.xml

Comments

  • Rule 1
  • Rule 2
  • Rule 3