pdmauto.sk
robots.txt

Robots Exclusion Standard data for pdmauto.sk

Resource Scan

Scan Details

Site Domain pdmauto.sk
Base Domain pdmauto.sk
Scan Status Ok
Last Scan2024-10-24T13:03:06+00:00
Next Scan 2024-11-23T13:03:06+00:00

Last Scan

Scanned2024-10-24T13:03:06+00:00
URL https://pdmauto.sk/robots.txt
Domain IPs 2a01:5f0:c001:119:216:3eff:fe01:3e0, 89.187.145.224
Response IP 89.187.145.224
Found Yes
Hash e8a81484153bd1b67f36203fd3959c24773a9306fadcd85231938e124922710b
SimHash 3e513bd167f3

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
bingbot
bingpreview
duckduckbot
duckduckgo-favicons-bot
facebot
facebookexternalhit
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
storebot-google
mediapartners-google
msnbot
msnbot-media
seznambot
slurp
zabbix*

Rule Path
Disallow /moja-garaz
Disallow /kosik
Disallow /prihlasenie
Disallow /moj-profil
Disallow /login

*

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.pdmauto.sk/sitemap-index.xml

Comments

  • ROBOTS.TXT
  • Alphabetically ordered whitelisting of legitimate web robots, which obey the
  • Robots Exclusion Standard (robots.txt). Each bot is shortly described in a
  • comment above the (list of) user-agent(s). Uncomment or delete bots you do
  • not wish to allow on your website / which do not need to visit your website.
  • Important: Blank lines are not allowed in the final robots.txt file!
  • Updates can be retrieved from: https://github.com/jonasjacek/robots.txt
  • This document is licensed with a CC BY-NC-SA 4.0 license.
  • Last update: 2020-02-20
  • google.com landing page quality checks
  • google.com app resource fetcher
  • bing ads bot
  • apple.com search engine
  • bing.com international search engine
  • duckduckgo.com international privacy search engine
  • facebook.com social network
  • google.com international search engine
  • google.com adsense bot
  • bing.com international search engine
  • seznam.cz czech search engine
  • yahoo.com international search engine
  • crawling rule(s) for above bots
  • disallow all other bots