Log In Sign Up

falter.at
robots.txt

Robots Exclusion Standard data for falter.at

Resource Scan

Scan Details

Site Domain falter.at
Base Domain falter.at
Scan Status Ok
Last Scan2024-06-25T19:01:19+00:00
Next Scan 2024-07-02T19:01:19+00:00

Last Scan

Scanned2024-06-25T19:01:19+00:00
URL https://falter.at/robots.txt
Redirect https://www.falter.at/robots.txt
Redirect Domain www.falter.at
Redirect Base falter.at
Domain IPs 159.69.32.43
Redirect IPs 159.69.32.43
Response IP 159.69.32.43
Found Yes
Hash 41f759537dcfaab1ab861a6c99e491d122013d4a73adae48bffd037ebffee30f
SimHash 6a089804f11a

Groups

emailcollector

Rule Path
Disallow /

*

Rule Path
Disallow /*ajax

twitterbot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /zeitung/paywall/overlay
Back to top

Other Records

Field Value
sitemap https://www.falter.at/sitemaps/sitemap_archiv_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_archiv_2.xml
sitemap https://www.falter.at/sitemaps/sitemap_archiv_3.xml
sitemap https://www.falter.at/sitemaps/sitemap_kinder_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_bov_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_complete_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_events_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_heureka_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_locations_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_podcast_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_rezensionen.xml
sitemap https://www.falter.at/sitemaps/sitemap_tvr_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_wwei_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_maily_1.xml
sitemap https://www.falter.at/sitemaps/sitemap_videos_1.xml
Back to top

Comments

  • www.falter.at
  • prevent indexing of ajax paths
Back to top