aicurious.io
robots.txt

Robots Exclusion Standard data for aicurious.io

Resource Scan

Scan Details

Site Domain aicurious.io
Base Domain aicurious.io
Scan Status Ok
Last Scan2024-09-21T07:58:39+00:00
Next Scan 2024-09-28T07:58:39+00:00

Last Scan

Scanned2024-09-21T07:58:39+00:00
URL https://aicurious.io/robots.txt
Redirect https://www.vietanh.dev/robots.txt
Redirect Domain www.vietanh.dev
Redirect Base vietanh.dev
Domain IPs 104.21.4.17, 172.67.131.133, 2606:4700:3032::ac43:8385, 2606:4700:3033::6815:411
Redirect IPs 104.21.20.197, 172.67.194.29, 2606:4700:3031::ac43:c21d, 2606:4700:3034::6815:14c5
Response IP 104.21.20.197
Found Yes
Hash d05830a749a04a9a9055ee13446d7cecc73758ab77d2ae30bf7578b2e548613f
SimHash 4109da544713

Groups

*

Rule Path
Allow /
Disallow /api/*

Other Records

Field Value
sitemap https://musing.vercel.app/sitemap.xml