cargoai.co
robots.txt

Robots Exclusion Standard data for cargoai.co

Resource Scan

Scan Details

Site Domain cargoai.co
Base Domain cargoai.co
Scan Status Ok
Last Scan2024-09-17T07:00:34+00:00
Next Scan 2024-10-17T07:00:34+00:00

Last Scan

Scanned2024-09-17T07:00:34+00:00
URL https://cargoai.co/robots.txt
Redirect https://www.cargoai.co/robots.txt
Redirect Domain www.cargoai.co
Redirect Base cargoai.co
Domain IPs 108.156.133.118, 108.156.133.124, 108.156.133.125, 108.156.133.94
Redirect IPs 13.35.18.114, 13.35.18.125, 13.35.18.71, 13.35.18.9
Response IP 13.35.18.9
Found Yes
Hash 1027baf6d34a0b7a04dd28b29eb185bdb3d34c52b2659fe5a289e755f112148f
SimHash 41108d654731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.cargoai.co/sitemap-index.xml

Warnings

  • `host` is not a known field.