aur-vesti.info
robots.txt

Robots Exclusion Standard data for aur-vesti.info

Resource Scan

Scan Details

Site Domain aur-vesti.info
Base Domain aur-vesti.info
Scan Status Ok
Last Scan2024-11-11T18:18:20+00:00
Next Scan 2024-11-18T18:18:20+00:00

Last Scan

Scanned2024-11-11T18:18:20+00:00
URL https://aur-vesti.info/robots.txt
Domain IPs 104.21.72.115, 172.67.183.177, 2606:4700:3032::6815:4873, 2606:4700:3034::ac43:b7b1
Response IP 104.21.72.115
Found Yes
Hash 724bcfc9eb2e4f226d029d53e58b19cdd5660e5e9b52499afe49e188eaaeebac
SimHash 69108e32c211

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /api/

Other Records

Field Value
sitemap https://aur-vesti.info/sitemap.xml

Warnings

  • `host` is not a known field.