e-media.at
robots.txt

Robots Exclusion Standard data for e-media.at

Resource Scan

Scan Details

Site Domain e-media.at
Base Domain e-media.at
Scan Status Ok
Last Scan2024-06-27T22:14:10+00:00
Next Scan 2024-07-04T22:14:10+00:00

Last Scan

Scanned2024-06-27T22:14:10+00:00
URL https://e-media.at/robots.txt
Redirect https://www.e-media.at/robots.txt
Redirect Domain www.e-media.at
Redirect Base e-media.at
Domain IPs 185.51.8.103
Redirect IPs 185.150.8.220, 194.182.181.219
Response IP 194.182.181.219
Found Yes
Hash b612347d1f6407d7a3d603a9e40cf04cc1147cec70488ab2b54d6f96cfad2fe2
SimHash efed104563db

Groups

bingbot

Rule Path
Disallow /ajax/
Disallow /cgi-bin/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /ajax/
Disallow /u/
Disallow /nw1/
Disallow /nw2/
Disallow /prod/
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://www.e-media.at/googlenews.xml
sitemap https://www.e-media.at/sitemap-topics.xml
sitemap https://www.e-media.at/sitemap-ressorts.xml
sitemap https://www.e-media.at/sitemap-articles-index.xml