Log In Sign Up

tejidospulido.com
robots.txt

Robots Exclusion Standard data for tejidospulido.com

Resource Scan

Scan Details

Site Domain tejidospulido.com
Base Domain tejidospulido.com
Scan Status Ok
Last Scan2024-05-11T16:09:44+00:00
Next Scan 2024-06-10T16:09:44+00:00

Last Scan

Scanned2024-05-11T16:09:44+00:00
URL https://tejidospulido.com/robots.txt
Domain IPs 2001:8d8:100f:f000::2c6, 217.160.0.15
Response IP 217.160.0.15
Found Yes
Hash ad8e53dd26a386891c539e95238f9c187c3c40cf72e9a67f3b2f9c8a68e280e6
SimHash 4ef4de19f7de

Groups

*

Rule Path
Disallow /epages/Site.admin/
Disallow /epages/*ViewAction%3DFacetedSearchProducts
Disallow /epages/*ViewAction%3DRemoteSearchProducts
Disallow /epages/*ViewAction%3DViewRemoteSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-ViewDetailRemoteSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailRemoteSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-ViewDetailFacetedSearchProducts
Disallow /epages/*ViewAction%3DMobileSF-DetailFacetedSearchProducts
Disallow /epages/*ViewAction%3DUnityViewAddToWishlistScript
Disallow /epages/*ViewAction%3DUnityViewFacebookBusinessPixelCode
Disallow /epages/*ViewAction%3DUnityViewRatenkaufBannerScript
Disallow /epages/*ViewAction%3DUnityViewRegisterSessionScript
Disallow /epages/*ViewAction%3DUnitySF-ViewGoogleAdWordsScript
Disallow /epages/*ViewAction%3DViewProductComparison
Disallow /epages/*ViewAction%3DViewRegistration
Disallow /epages/*ViewAction%3DViewLostPassword
Disallow /epages/*ViewAction%3DViewInquiry

pricebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60
Back to top

Comments

  • robots.txt for epages
  • applies to all robots
  • disallow TBO, PBO
  • prevent mass indexing of search pages
Back to top