Log In Sign Up

salzburg24.at
robots.txt

Robots Exclusion Standard data for salzburg24.at

Resource Scan

Scan Details

Site Domain salzburg24.at
Base Domain salzburg24.at
Scan Status Ok
Last Scan2024-06-01T21:31:59+00:00
Next Scan 2024-06-08T21:31:59+00:00

Last Scan

Scanned2024-06-01T21:31:59+00:00
URL https://salzburg24.at/robots.txt
Redirect https://www.salzburg24.at/robots.txt
Redirect Domain www.salzburg24.at
Redirect Base salzburg24.at
Domain IPs 185.69.160.93
Redirect IPs 185.69.160.93
Response IP 185.69.160.93
Found Yes
Hash 313fc37313c9f6b9648e6b4e91a89152f83950d65d5170a06218a7936bc11a55
SimHash 08108914cc11

Groups

*

Rule Path
Allow /
Disallow /ajax/
Disallow /_ajax/
Disallow /files/
Disallow /test/
Disallow /extern/
Disallow /jsapi/
Disallow /endless/
Disallow /singles/

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.salzburg24.at/sitemapnews.xml
sitemap https://www.salzburg24.at/sitemapindex.xml
sitemap https://www.salzburg24.at/sitemapimage.xml
sitemap https://www.salzburg24.at/sitemapvideo.xml
sitemap https://www.salzburg24.at/sitemaphtml
Back to top

Comments

  • OpenAI / ChatGPT
  • Common Crawl
  • SEMrushBot
  • Googles generative AI crawlers (Bard)
  • Another AI Bot
Back to top