my.cargoboard.com
robots.txt

Robots Exclusion Standard data for my.cargoboard.com

Resource Scan

Scan Details

Site Domain my.cargoboard.com
Base Domain cargoboard.com
Scan Status Ok
Last Scan2025-11-21T07:07:53+00:00
Next Scan 2025-12-21T07:07:53+00:00

Last Scan

Scanned2025-11-21T07:07:53+00:00
URL https://my.cargoboard.com/robots.txt
Domain IPs 34.149.70.61
Response IP 34.149.70.61
Found Yes
Hash 3e18cbc9424fdd85a984ec2c262637b67fa6fa00248761679a2d43772c4c3c15
SimHash 20406b90ea72

Groups

*

Rule Path
Disallow /cdn/
Disallow /ui/
Disallow /hook/

Comments

  • stop crawling for async endpoints