stores-locator.com
robots.txt

Robots Exclusion Standard data for stores-locator.com

Resource Scan

Scan Details

Site Domain stores-locator.com
Base Domain stores-locator.com
Scan Status Ok
Last Scan2024-11-04T14:10:28+00:00
Next Scan 2024-11-11T14:10:28+00:00

Last Scan

Scanned2024-11-04T14:10:28+00:00
URL https://stores-locator.com/robots.txt
Redirect https://www.stores-locator.com/robots.txt
Redirect Domain www.stores-locator.com
Redirect Base stores-locator.com
Domain IPs 91.121.45.253
Redirect IPs 91.121.45.253
Response IP 91.121.45.253
Found Yes
Hash 9759dacdb9f3b7d68420df97334fc89b5318c90d654d287dd2f96af2ee227beb
SimHash 0dca4d82c013

Groups

*

Rule Path
Disallow /admin
Disallow /login
Disallow /index.php
Disallow /news/tag/*
Disallow /news/chainstores-*
Disallow /search/
Disallow /add-a-store
Disallow /wp-login.php
Disallow /wp-admin
Disallow /api/xmlrpc
Disallow /*/api/xmlrpc
Disallow /.git/config
Disallow /*/.git/config

baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-sfkr
baiduspider-cpro

Rule Path
Disallow /

yandex
yandexbot
yandexmedia
yandeximages
yandexcatalog
yandexdirect
yandexblogs
yandexnews
yandexpagechecker

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.stores-locator.com/sitemap.xml

Comments

  • Disallow: /contact
  • Disallow: /legal-notice
  • Disallow: /personal-data