avgle.ninja
robots.txt

Robots Exclusion Standard data for avgle.ninja

Resource Scan

Scan Details

Site Domain avgle.ninja
Base Domain avgle.ninja
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-10-15T13:45:27+00:00
Next Scan 2025-11-14T13:45:27+00:00

Last Successful Scan

Scanned2025-09-09T08:41:41+00:00
URL https://avgle.ninja/robots.txt
Domain IPs 104.21.11.109, 172.67.191.220, 2606:4700:3031::ac43:bfdc, 2606:4700:3033::6815:b6d
Response IP 172.67.191.220
Found Yes
Hash 2a5ad6c8dca87b32e29eedf2841bdfcf0e2ca8553e954fa6bb6aaa6f8380cc54
SimHash 6d098850c7ba

Groups

yandex

Rule Path
Disallow /download/*

Other Records

Field Value
crawl-delay 2.0

bingbot

Rule Path
Disallow /download/*

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /download/*

Other Records

Field Value
sitemap https://avgle.ninja/sitemap.xml

Warnings

  • `host` is not a known field.