rc-drift-shop.com
robots.txt

Robots Exclusion Standard data for rc-drift-shop.com

Resource Scan

Scan Details

Site Domain rc-drift-shop.com
Base Domain rc-drift-shop.com
Scan Status Ok
Last Scan2025-10-28T20:30:43+00:00
Next Scan 2025-11-27T20:30:43+00:00

Last Scan

Scanned2025-10-28T20:30:43+00:00
URL https://rc-drift-shop.com/robots.txt
Domain IPs 2a01:238:20a:202:1041:0:145:46, 81.169.145.46
Response IP 81.169.145.46
Found Yes
Hash 662b090cd4746c23505811306470d8ccd7a4a0c129d5273c44834e1d69f7b862
SimHash 5cb4d31be7f6

Groups

*

Rule Path
Disallow /epages/Site.admin/
Disallow /epages/*ViewAction%3DFacetedSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailFacetedSearchProducts
Disallow /epages/*ViewAction%3DViewFaceted
Disallow /epages/*ViewAction%3DDetailSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailSearchProducts
Disallow /epages/*ViewAction%3DViewDetailSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-ViewDetailSearchProducts
Disallow /epages/*ViewAction%3DViewContentSearchMask
Disallow /epages/*ViewAction%3DContentSearch
Disallow /epages/*ViewAction%3DViewProductComparison
Disallow /epages/*ViewAction%3DUnityViewFacebookBusinessPixelCode
Disallow /epages/*ViewAction%3DUnityViewRatenkaufBannerScript
Disallow /epages/*ViewAction%3DUnitySF-ViewGoogleAdWordsScript
Disallow /epages/*ViewAction%3DUnityViewGoogleSmartShoppingScript
Disallow /epages/*ViewAction%3DViewPayPalPPCPScript
Disallow /epages/*ViewAction%3DUnityViewEP6Script
Disallow /epages/*ViewAction%3DUnityViewEP6CookiesScript
Disallow /rs/*

pricebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • robots.txt for epages
  • applies to all robots
  • disallow TBO, PBO
  • prevent mass indexing of search pages