gusto.at
robots.txt

Robots Exclusion Standard data for gusto.at

Resource Scan

Scan Details

Site Domain gusto.at
Base Domain gusto.at
Scan Status Ok
Last Scan2024-06-14T17:15:30+00:00
Next Scan 2024-06-21T17:15:30+00:00

Last Scan

Scanned2024-06-14T17:15:30+00:00
URL https://gusto.at/robots.txt
Redirect https://www.gusto.at/robots.txt
Redirect Domain www.gusto.at
Redirect Base gusto.at
Domain IPs 185.51.8.103
Redirect IPs 185.150.8.220, 194.182.181.219
Response IP 194.182.181.219
Found Yes
Hash 749841477e4026acb80e58c28aa5334b34570cf2df89f0acb05bc6e1da82c784
SimHash 6f55582d83d3

Groups

bingbot

Rule Path
Disallow /ajax/
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ajax/
Disallow /u/
Disallow /nw1/
Disallow /nw2/
Disallow /prod/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.gusto.at/sitemap-ressorts.xml
sitemap https://www.gusto.at/sitemap-topics.xml
sitemap https://www.gusto.at/sitemap-articles-index.xml