Log In Sign Up

dvor.com
robots.txt

Robots Exclusion Standard data for dvor.com

Resource Scan

Scan Details

Site Domain dvor.com
Base Domain dvor.com
Scan Status Ok
Last Scan2026-01-05T21:28:32+00:00
Next Scan 2026-01-19T21:28:32+00:00

Last Scan

Scanned2026-01-05T21:28:32+00:00
URL https://dvor.com/robots.txt
Redirect https://www.dvor.com/robots.txt
Redirect Domain www.dvor.com
Redirect Base dvor.com
Domain IPs 18.189.124.49, 18.219.57.71, 3.12.6.1
Redirect IPs 2.17.106.82, 2.17.106.85
Response IP 23.52.171.147
Found Yes
Hash b33df035b8c053fed1f9d95d61f929a4ffb5f58cbe0b7370001252bf062e2a4c
SimHash 6cba3b55ad10

Groups

*

Rule Path
Disallow /staging/
Disallow /cgi-bin/
Disallow /RT/
Disallow /TG/
Disallow /QS/
Disallow /wgl/
Disallow /P/
Disallow /ymix/
Disallow /OS/
Disallow /cs/
Disallow /en%3D
Disallow /p/s%3D
Disallow /bt%3D
Disallow /sid%3D
Disallow /io%3D
Disallow /ii%3D
Disallow /api/
Disallow /iv-api/
Disallow /checkout/
Disallow /email/manage
Disallow /email/unsubscribe
Disallow /email/hold
Disallow /email/resubscribe
Disallow /fed-experiments-7ae6f108-47ff-4853-ad45-c50e7f1fc5e9/
Disallow /utc-time
Disallow /nelmio-js-logger

roverbot

Rule Path
Disallow /

spotbot

Rule Path
Disallow /

fatbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

halebot

Rule Path
Disallow /
Disallow /plugins/feedback.php
Disallow /s/
Back to top

Other Records

Field Value
sitemap https://www.dvor.com/sitemap.product.entity.unorderable.generic.multivariant.index.xml
sitemap https://www.dvor.com/sitemap.product.entity.orderable.generic.single-variant.index.xml
sitemap https://www.dvor.com/sitemap.product.entity.orderable.generic.multivariant.index.xml
sitemap https://www.dvor.com/sitemap.product.entity.unorderable.generic.single-variant.index.xml
sitemap https://www.dvor.com/sitemap.list.category.index.xml
sitemap https://www.dvor.com/sitemap.department.product-list.unorderable.index.xml
sitemap https://www.dvor.com/sitemap.brand.product-list.generic.index.xml
sitemap https://www.dvor.com/sitemap.other.index.xml
sitemap https://www.dvor.com/sitemap.brand.product-list.unorderable.index.xml
sitemap https://www.dvor.com/sitemap.list.department.index.xml
sitemap https://www.dvor.com/sitemap.info.entity.generic.index.xml
sitemap https://www.dvor.com/sitemap.info.entity.home.index.xml
sitemap https://www.dvor.com/sitemap.promotion.list.index.xml
sitemap https://www.dvor.com/sitemap.category.product-list.generic.index.xml
sitemap https://www.dvor.com/sitemap.list.brand.index.xml
sitemap https://www.dvor.com/sitemap.department.product-list.generic.index.xml
sitemap https://www.dvor.com/sitemap.product.unorderable.index.xml
sitemap https://www.dvor.com/sitemap.product.orderable.index.xml
sitemap https://www.dvor.com/sitemap.info.content.index.xml
sitemap https://www.dvor.com/sitemap.xml
Back to top

Comments

  • Sitemaps
  • Cap is html
  • Rover is a bad dog <http://www.roverbot.com>
  • Block Indix.com
  • Block TheFind.com
  • Block CommonCrawl
  • Block Halebot (biggeye.tacitknowledge.com)
  • Googlebot doesn't work well with Facebook Comments
Back to top