anv.su
robots.txt

Robots Exclusion Standard data for anv.su

Resource Scan

Scan Details

Site Domain anv.su
Base Domain anv.su
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-16T12:07:04+00:00
Next Scan 2024-08-15T12:07:04+00:00

Last Successful Scan

Scanned2024-03-26T12:02:55+00:00
URL https://anv.su/robots.txt
Redirect https://anvplay.site:443/robots.txt
Redirect Domain anvplay.site
Redirect Base anvplay.site
Domain IPs 104.21.61.209, 172.67.215.35, 2606:4700:3033::ac43:d723, 2606:4700:3035::6815:3dd1
Redirect IPs 104.21.64.76, 172.67.178.119, 2606:4700:3032::ac43:b277, 2606:4700:3033::6815:404c
Response IP 104.21.64.76
Found Yes
Hash cc3993efeb0918d1101ec8bb897518a9e23be777691579a1a27c3bbdeae91b99
SimHash 021cda728377

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /author
Disallow /url

Other Records

Field Value
crawl-delay 120

ccbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /author
Disallow /url

googlebot-image

Rule Path
Allow /wp-content/uploads/

yandeximages

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://anvplay.site/sitemap.xml

Warnings

  • `host` is not a known field.