Log In Sign Up

curveit.com
robots.txt

Robots Exclusion Standard data for curveit.com

Resource Scan

Scan Details

Site Domain curveit.com
Base Domain curveit.com
Scan Status Ok
Last Scan5/9/2025, 7:40:10 PM
Next Scan 6/8/2025, 7:40:10 PM

Last Scan

Scanned5/9/2025, 7:40:10 PM
URL https://curveit.com/robots.txt
Redirect https://www.curveit.com/robots.txt
Redirect Domain www.curveit.com
Redirect Base curveit.com
Domain IPs 217.160.0.238
Redirect IPs 217.160.0.238
Response IP 217.160.0.238
Found Yes
Hash 6d8037b107f94c720c9a7985a3d59653765c037c6245a9a4409b3e849f510675
SimHash 4840cad0f593

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.curveit.com/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK
Back to top