Log In Sign Up

crowdsmart.ai
robots.txt

Robots Exclusion Standard data for crowdsmart.ai

Resource Scan

Scan Details

Site Domain crowdsmart.ai
Base Domain crowdsmart.ai
Scan Status Ok
Last Scan2024-05-09T07:40:15+00:00
Next Scan 2024-06-08T07:40:15+00:00

Last Scan

Scanned2024-05-09T07:40:15+00:00
URL https://crowdsmart.ai/robots.txt
Redirect https://www.crowdsmart.ai/robots.txt
Redirect Domain www.crowdsmart.ai
Redirect Base crowdsmart.ai
Domain IPs 13.35.18.13, 13.35.18.19, 13.35.18.41, 13.35.18.80, 2600:9000:20c7:3800:d:1853:5440:93a1, 2600:9000:20c7:4200:d:1853:5440:93a1, 2600:9000:20c7:8e00:d:1853:5440:93a1, 2600:9000:20c7:9800:d:1853:5440:93a1, 2600:9000:20c7:d000:d:1853:5440:93a1, 2600:9000:20c7:e00:d:1853:5440:93a1, 2600:9000:20c7:e200:d:1853:5440:93a1, 2600:9000:20c7:ee00:d:1853:5440:93a1
Redirect IPs 108.156.133.119, 108.156.133.17, 108.156.133.40, 108.156.133.68, 2600:9000:2755:2c00:e:545e:e8c0:93a1, 2600:9000:2755:4c00:e:545e:e8c0:93a1, 2600:9000:2755:6000:e:545e:e8c0:93a1, 2600:9000:2755:7400:e:545e:e8c0:93a1, 2600:9000:2755:c00:e:545e:e8c0:93a1, 2600:9000:2755:ce00:e:545e:e8c0:93a1, 2600:9000:2755:d000:e:545e:e8c0:93a1, 2600:9000:2755:d400:e:545e:e8c0:93a1
Response IP 108.156.133.68
Found Yes
Hash 71e7abaa6d523b412ef23a327457e12d7839b26c8436e53aad6db5732af77ff3
SimHash 280c8880e192

Groups

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.crowdsmart.ai/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top