vgn.at
robots.txt

Robots Exclusion Standard data for vgn.at

Resource Scan

Scan Details

Site Domain vgn.at
Base Domain vgn.at
Scan Status Ok
Last Scan2024-05-28T03:06:52+00:00
Next Scan 2024-06-27T03:06:52+00:00

Last Scan

Scanned2024-05-28T03:06:52+00:00
URL https://vgn.at/robots.txt
Redirect https://www.vgn.at/robots.txt
Redirect Domain www.vgn.at
Redirect Base vgn.at
Domain IPs 185.51.8.103
Redirect IPs 185.150.8.220, 194.182.181.219
Response IP 185.150.8.220
Found Yes
Hash c0d71966a30906c6af12d60f035a2f2e30d71ad210ecfc467e2fa82e41c4e244
SimHash 7fcd486547d3

Groups

bingbot

Rule Path
Disallow /ajax/
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ajax/
Disallow /u/
Disallow /nw1/
Disallow /nw2/
Disallow /prod/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.vgn.at/sitemap-ressorts.xml
sitemap https://www.vgn.at/sitemap-topics.xml
sitemap https://www.vgn.at/sitemap-articles-index.xml