Log In Sign Up

shiplear.com
robots.txt

Robots Exclusion Standard data for shiplear.com

Resource Scan

Scan Details

Site Domain shiplear.com
Base Domain shiplear.com
Scan Status Ok
Last Scan2025-08-18T12:47:54+00:00
Next Scan 2025-09-17T12:47:54+00:00

Last Scan

Scanned2025-08-18T12:47:54+00:00
URL https://shiplear.com/robots.txt
Domain IPs 2a02:4780:84:4f0f:5e8c:678:e24a:f206, 2a02:4780:84:a23a:38de:c251:2a4e:6cc1, 93.127.187.220, 93.127.201.158
Response IP 179.61.189.221
Found Yes
Hash 584b9991d2f65fd5192c0bfa747478e741aef4f393351732ecbeacdea7b339b5
SimHash 50248952cb84

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /private/

*

Rule Path
Disallow /checkout/

googlebot

Rule Path
Allow /public/

*

Rule Path
Disallow /public/
Back to top

Other Records

Field Value
sitemap https://www.shiplear.com/sitemap.xml
Back to top

Comments

  • Allow all bots to access the entire site
  • Block a specific bot (e.g., Googlebot) from accessing a directory
  • Disallow all bots from accessing a specific folder
  • Allow Googlebot to access a specific folder but block all other bots
  • Sitemap location
Back to top