avail.app
robots.txt

Robots Exclusion Standard data for avail.app

Resource Scan

Scan Details

Site Domain avail.app
Base Domain avail.app
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-11-26T20:38:40+00:00
Next Scan 2026-01-25T20:38:40+00:00

Last Successful Scan

Scanned2025-09-21T07:25:14+00:00
URL https://avail.app/robots.txt
Domain IPs 104.21.86.65, 172.67.216.88, 2606:4700:3030::6815:5641, 2606:4700:3032::ac43:d858
Response IP 104.21.86.65
Found Yes
Hash 21b0d340427ea6ea9bf59bab9744a3b7e279486a8ab96991efae5daa3c6baa87
SimHash a42d8c048d93

Groups

*

Rule Path
Disallow /admin
Disallow /design
Disallow /signin
Disallow /signup

Other Records

Field Value
sitemap https://avail.app/sitemap.xml