myeship.co
robots.txt

Robots Exclusion Standard data for myeship.co

Resource Scan

Scan Details

Site Domain myeship.co
Base Domain myeship.co
Scan Status Ok
Last Scan2026-02-05T14:32:48+00:00
Next Scan 2026-03-07T14:32:48+00:00

Last Scan

Scanned2026-02-05T14:32:48+00:00
URL https://myeship.co/robots.txt
Domain IPs 216.150.1.1
Response IP 216.150.1.1
Found Yes
Hash 7278112e5ef1085b56fee9f4b0893e4b033703cd5d168ae0e02692fb3c13c1bf
SimHash 481eca12e790

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /admin/
Disallow /private/
Disallow /auth/

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 0

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://myeship.co/sitemap.xml

Comments

  • Robots.txt for eShip
  • https://myeship.co
  • Allow all bots
  • Sitemap location
  • Crawl-delay for bots that respect it
  • Specific rules for major search engines
  • Block bad bots