runrug.com
robots.txt

Robots Exclusion Standard data for runrug.com

Resource Scan

Scan Details

Site Domain runrug.com
Base Domain runrug.com
Scan Status Ok
Last Scan2025-09-11T13:25:56+00:00
Next Scan 2025-10-11T13:25:56+00:00

Last Scan

Scanned2025-09-11T13:25:56+00:00
URL https://runrug.com/robots.txt
Redirect https://www.runrug.com/us/robots.txt
Redirect Domain www.runrug.com
Redirect Base runrug.com
Domain IPs 109.108.148.102
Redirect IPs 109.108.148.112
Response IP 109.108.148.112
Found Yes
Hash ec661b5eb235e6cbb0c947f3f1df1a9b1830c7ec49a9734498ec3f1e710f1aaf
SimHash 4256d6c0d248

Groups

etaospider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

brandverity

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefssiteaudit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

pricebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

charlotte

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

Rule Path
Allow /
Disallow /ajax/removefrombasket/
Disallow /us/ajax/removefrombasket/
Disallow /au/ajax/removefrombasket/
Disallow /ca/ajax/removefrombasket/
Disallow /fr/ajax/removefrombasket/
Disallow /de/ajax/removefrombasket/
Disallow /basket$
Disallow /us/basket$
Disallow /au/basket$
Disallow /ca/basket$
Disallow /fr/basket$
Disallow /de/basket$
Disallow /checkout/
Disallow /us/checkout/
Disallow /au/checkout/
Disallow /ca/checkout/
Disallow /fr/checkout/
Disallow /de/checkout/
Disallow /errors/
Disallow /us/errors/
Disallow /au/errors/
Disallow /ca/errors/
Disallow /fr/errors/
Disallow /de/errors/
Disallow /quickbuy/
Disallow /us/quickbuy/
Disallow /au/quickbuy/
Disallow /ca/quickbuy/
Disallow /fr/quickbuy/
Disallow /de/quickbuy/
Disallow /product_personalisation/
Disallow /us/product_personalisation/
Disallow /au/product_personalisation/
Disallow /ca/product_personalisation/
Disallow /fr/product_personalisation/
Disallow /de/product_personalisation/
Disallow /register/
Disallow /us/register/
Disallow /au/register/
Disallow /ca/register/
Disallow /fr/register/
Disallow /de/register/
Disallow /register
Disallow /us/register
Disallow /au/register
Disallow /ca/register
Disallow /fr/register
Disallow /de/register
Disallow /vs/
Disallow /us/vs/
Disallow /au/vs/
Disallow /ca/vs/
Disallow /fr/vs/
Disallow /de/vs/
Disallow /images/products/yofla/
Disallow /us/images/products/yofla/
Disallow /au/images/products/yofla/
Disallow /ca/images/products/yofla/
Disallow /fr/images/products/yofla/
Disallow /de/images/products/yofla/
Disallow /customer_groups/choose_group/
Disallow /us/customer_groups/choose_group/
Disallow /au/customer_groups/choose_group/
Disallow /ca/customer_groups/choose_group/
Disallow /fr/customer_groups/choose_group/
Disallow /de/customer_groups/choose_group/
Disallow /formbuilder/
Disallow /us/formbuilder/
Disallow /au/formbuilder/
Disallow /ca/formbuilder/
Disallow /fr/formbuilder/
Disallow /de/formbuilder/
Disallow /callbacks/
Disallow /us/callbacks/
Disallow /au/callbacks/
Disallow /ca/callbacks/
Disallow /fr/callbacks/
Disallow /de/callbacks/
Disallow /ajax/formatprice/
Disallow /us/ajax/formatprice/
Disallow /au/ajax/formatprice/
Disallow /ca/ajax/formatprice/
Disallow /fr/ajax/formatprice/
Disallow /de/ajax/formatprice/
Disallow /products/
Disallow /us/products/
Disallow /au/products/
Disallow /ca/products/
Disallow /fr/products/
Disallow /de/products/
Disallow /search/
Disallow /sale/
Disallow *?sort=*
Disallow /feature_testing
Disallow /samples/
Disallow /new-products/
Disallow /returns
Allow /furlong-flooring-m68
Disallow /customer/
Disallow /wishlist*
Disallow /blog/wp-admin/admin-ajax.php
Disallow /us/blog/wp-admin/admin-ajax.php
Disallow /au/blog/wp-admin/admin-ajax.php
Disallow /ca/blog/wp-admin/admin-ajax.php
Disallow /fr/blog/wp-admin/admin-ajax.php
Disallow /de/blog/wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://www.runrug.com/sitemap-index.xml
sitemap https://www.runrug.com/us/sitemap-index.xml
sitemap https://www.runrug.com/au/sitemap-index.xml
sitemap https://www.runrug.com/ca/sitemap-index.xml
sitemap https://www.runrug.com/fr/sitemap-index.xml
sitemap https://www.runrug.com/de/sitemap-index.xml
sitemap https://www.runrug.com/blog/sitemap.xml

Warnings

  • `request-rate` is not a known field.