nd-rack.de
robots.txt

Robots Exclusion Standard data for nd-rack.de

Resource Scan

Scan Details

Site Domain nd-rack.de
Base Domain nd-rack.de
Scan Status Ok
Last Scan2024-10-24T08:19:32+00:00
Next Scan 2024-11-23T08:19:32+00:00

Last Scan

Scanned2024-10-24T08:19:32+00:00
URL https://nd-rack.de/robots.txt
Domain IPs 2001:8d8:100f:f000::249, 217.160.0.58
Response IP 217.160.0.58
Found Yes
Hash a54a777f8cf6e83d99f12208c027e99ced529a3383bfbd6a93f053c55bc199eb
SimHash 0eb4db1be7dc

Groups

*

Rule Path
Disallow /epages/Site.admin/
Disallow /epages/*ViewAction%3DFacetedSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailFacetedSearchProducts
Disallow /epages/*ViewAction%3DViewFaceted
Disallow /epages/*ViewAction%3DDetailSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailSearchProducts
Disallow /epages/*ViewAction%3DViewDetailSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-ViewDetailSearchProducts
Disallow /epages/*ViewAction%3DViewContentSearchMask
Disallow /epages/*ViewAction%3DContentSearch
Disallow /epages/*ViewAction%3DUnityViewAddToWishlistScript
Disallow /epages/*ViewAction%3DUnityViewFacebookBusinessPixelCode
Disallow /epages/*ViewAction%3DUnityViewRatenkaufBannerScript
Disallow /epages/*ViewAction%3DUnityViewRegisterSessionScript
Disallow /epages/*ViewAction%3DUnitySF-ViewGoogleAdWordsScript
Disallow /epages/*ViewAction%3DUnityViewGoogleSmartShoppingScript
Disallow /epages/*ViewAction%3DUnityViewMetaCatalogScript
Disallow /epages/*ViewAction%3DUnityViewPayPalPPCPScript
Disallow /epages/*ViewAction%3DViewPayPalPPCPScript

pricebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

Comments

  • robots.txt for epages
  • applies to all robots
  • disallow TBO, PBO
  • prevent mass indexing of search pages