yesship.com
robots.txt

Robots Exclusion Standard data for yesship.com

Resource Scan

Scan Details

Site Domain yesship.com
Base Domain yesship.com
Scan Status Ok
Last Scan2024-09-25T21:19:37+00:00
Next Scan 2024-10-02T21:19:37+00:00

Last Scan

Scanned2024-09-25T21:19:37+00:00
URL https://yesship.com/robots.txt
Redirect https://www.yesship.com/robots.txt
Redirect Domain www.yesship.com
Redirect Base yesship.com
Domain IPs 104.21.54.101, 172.67.168.110, 2606:4700:3035::6815:3665, 2606:4700:3037::ac43:a86e
Redirect IPs 104.21.54.101, 172.67.168.110, 2606:4700:3035::6815:3665, 2606:4700:3037::ac43:a86e
Response IP 172.67.168.110
Found Yes
Hash 69c1a9cfd9021fa385f54920c002df0a0fa8343f8c482be22071d2e36a849b4a
SimHash 003c7103c707

Groups

googlebot

Rule Path
Allow /
Disallow /adm/
Disallow /login/
Disallow /admin/
Disallow /banner/
Disallow /cs/
Disallow /direct/
Disallow /track/
Disallow /proposal/
Disallow /member.php

yeti

Rule Path
Allow /
Disallow /adm/
Disallow /login/
Disallow /admin/
Disallow /banner/
Disallow /cs/
Disallow /direct/
Disallow /track/
Disallow /proposal/
Disallow /member.php

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

amazonbot

Product Comment
amazonbot Amazon's user agent
Rule Path
Disallow /

amazon-kendra-web-crawler-*

Product Comment
amazon-kendra-web-crawler-* all customers of Amazon Kendra's web crawler
Rule Path Comment
Disallow / disallow everything

amazon cloudfront

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /