Log In Sign Up

yoursurprise.com
robots.txt

Robots Exclusion Standard data for yoursurprise.com

Resource Scan

Scan Details

Site Domain yoursurprise.com
Base Domain yoursurprise.com
Scan Status Ok
Last Scan2024-05-31T03:38:55+00:00
Next Scan 2024-06-30T03:38:55+00:00

Last Scan

Scanned2024-05-31T03:38:55+00:00
URL https://yoursurprise.com/robots.txt
Redirect https://www.yoursurprise.com/robots.txt
Redirect Domain www.yoursurprise.com
Redirect Base yoursurprise.com
Domain IPs 2600:1901:0:b75c::, 34.120.33.68
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133, 2a04:4e42:200::645, 2a04:4e42:400::645, 2a04:4e42:600::645, 2a04:4e42::645
Response IP 151.101.66.133
Found Yes
Hash 56426f5b6613e89a67765eaa3695dfa20f6f65adb9d0e5b5c7612e46c293e86e
SimHash 2a18b055c934

Groups

*

Rule Path
Disallow /assets/templates/ysp/plugins/
Disallow /plugins/
Disallow /assets/templates/ysp/flash/
Disallow /assets/templates/ysp/css/
Disallow /services/
Disallow /mysurprise/
Disallow /checkout/
Disallow *?sa3=*
Disallow *?affiliate=*
Disallow *?groep=*
Disallow *?dCampaign=*
Disallow *?tap_a=*
Disallow *?desktop=*
Disallow *?lang=*
Disallow *?mc_cid=*
Disallow *?showAll=*
Disallow *?vero_conv*
Disallow *zoeken?trefwoord=*
Disallow *search?*
Disallow *designid*
Allow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-ba

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-si

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-swa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-ct

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-bm

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

semrushbot-seoab

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30
Back to top

Other Records

Field Value
sitemap https://www.yoursurprise.com/sitemap.xml
Back to top

Comments

  • groep 1:
  • Slow down all semrush bots
Back to top