vyos.dev
robots.txt

Robots Exclusion Standard data for vyos.dev

Resource Scan

Scan Details

Site Domain vyos.dev
Base Domain vyos.dev
Scan Status Ok
Last Scan2025-06-14T23:56:42+00:00
Next Scan 2025-07-14T23:56:42+00:00

Last Scan

Scanned2025-06-14T23:56:42+00:00
URL https://vyos.dev/robots.txt
Domain IPs 104.26.10.97, 104.26.11.97, 172.67.68.159, 2606:4700:20::681a:a61, 2606:4700:20::681a:b61, 2606:4700:20::ac43:449f
Response IP 104.26.10.97
Found Yes
Hash a6f611167fb4bed04cb1712f296a7e0c4e42b09278d58af50df876b2f62c7e38
SimHash 65087af2cfb0

Groups

*

Rule Path
Disallow /diffusion/
Disallow /source/
Disallow /r*
Disallow /P*%24*

Other Records

Field Value
crawl-delay 1