curiositti.com
robots.txt

Robots Exclusion Standard data for curiositti.com

Resource Scan

Scan Details

Site Domain curiositti.com
Base Domain curiositti.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan3/14/2025, 1:38:57 AM
Next Scan 6/12/2025, 1:38:57 AM

Last Successful Scan

Scanned5/19/2024, 1:37:22 AM
URL https://curiositti.com/robots.txt
Domain IPs 104.21.71.153, 172.67.170.185, 2606:4700:3032::6815:4799, 2606:4700:3032::ac43:aab9
Response IP 172.67.170.185
Found Yes
Hash 153de27c51027e37943943c90352cacae9914cba50c79d7aba5d22146a2bbd54
SimHash 4208dc806683

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Comments

  • vestacp autogenerated robots.txt