Log In Sign Up

teltarif.ch
robots.txt

Robots Exclusion Standard data for teltarif.ch

Resource Scan

Scan Details

Site Domain teltarif.ch
Base Domain teltarif.ch
Scan Status Ok
Last Scan2024-06-03T22:32:58+00:00
Next Scan 2024-06-10T22:32:58+00:00

Last Scan

Scanned2024-06-03T22:32:58+00:00
URL https://teltarif.ch/robots.txt
Redirect https://www.teltarif.ch/robots.txt
Redirect Domain www.teltarif.ch
Redirect Base teltarif.ch
Domain IPs 116.203.8.242, 2a01:4f8:1c0c:82cc::2
Redirect IPs 116.203.8.242, 2a01:4f8:1c0c:82cc::2
Response IP 116.203.8.242
Found Yes
Hash b3ff9c70a073e8d51702fc249fe054c22db34f4b1de11953a1eab9cd59440804
SimHash a15c5a602dc8

Groups

googlebot-news

Rule Path
Disallow /a/
Disallow /ad/
Disallow /ads/
Disallow /adv/
Disallow /app/news/
Disallow /app/netzbewertung/
Disallow /auskunft/
Disallow /blitz/
Disallow /cebit/
Disallow /cgi-bin/
Disallow /chronik/
Disallow /click/
Disallow /computer/
Disallow /consumer-electronics-show/
Disallow /content/
Disallow /db/
Disallow /dienste/
Disallow /discounter/
Disallow /facebook/
Disallow /fernsehen/
Disallow /festnetz/
Disallow /flatrate/
Disallow /forum/
Disallow /gewinnspiel/
Disallow /h/
Disallow /handy/
Disallow /hardware/
Disallow /hausbau/
Disallow /heimvernetzung/
Disallow /i/
Disallow /ifa-berlin/
Disallow /intern/
Disallow /internet/
Disallow /jobs/
Disallow /kids-und-teens/
Disallow /kommunikation-zuhause/
Disallow /lifestyle/
Disallow /media/
Disallow /mobile-kommunikation/
Disallow /mobile-world-congres/
Disallow /mobilfunk/
Disallow /moderne-netze/
Disallow /multimedia/
Disallow /navigation/
Disallow /netbook/
Disallow /newsticker/
Disallow /nl/
Disallow /podcast/
Disallow /presse/
Disallow /promotion/
Disallow /radio/
Disallow /ratgeber/
Disallow /reise/
Disallow /roaming/
Disallow /senioren/
Disallow /service/
Disallow /sicherheit/
Disallow /smartphone/
Disallow /smartwatch/
Disallow /specials/
Disallow /sport/
Disallow /tablet/
Disallow /tag/
Disallow /tarif-rechner/
Disallow /tarife-und-geraete/
Disallow /tarife/
Disallow /technik/
Disallow /telefonanlage/
Disallow /telefonieren-zuhause/
Disallow /teltarif-hilft/
Disallow /test/
Disallow /umfrage/
Disallow /umzug/
Disallow /unterwegs/
Disallow /ttt.gif
Disallow /ttt.gif*
Disallow /ttt.go
Disallow /ttt.go*
Disallow /ttt.png
Disallow /ttt.png*
Disallow /user/
Disallow /verbraucher/
Disallow /video/
Disallow /voip/
Disallow /widget/
Disallow /wlan/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /ad/
Allow /ads/*.a%3D22
Allow /ads/*.a%3D40
Allow /ads/*.a%3D41
Allow /ads/*.a%3D42
Allow /ads/*.a%3D43
Allow /ads/*.a%3D44
Allow /ads/*.a%3D45
Allow /ads/*.a%3D46
Allow /ads/*.a%3D$
Allow /click/*.a%3D40
Allow /click/*.a%3D41
Allow /click/*.a%3D42
Allow /click/*.a%3D43
Allow /click/*.a%3D44
Allow /click/*.a%3D45
Allow /click/*.a%3D46
Allow /click/*.a%3D47130
Allow /click/*.a%3D47131
Disallow /ads/
Disallow /click/
Disallow /user/
Disallow /intern/action/print/
Disallow /ttt.gif
Disallow /ttt.gif*
Disallow /ttt.go
Disallow /ttt.go*
Disallow /ttt.png
Disallow /ttt.png*
Disallow /app/news/
Disallow /app/netzbewertung/
Disallow /widget/idealo/
Disallow /widget/cta/
Disallow /widget/newsfeed/
Disallow /db/res.html*city%3D*
Back to top

Other Records

Field Value
sitemap https://www.teltarif.de/h/sitemap.xml
sitemap https://www.teltarif.de/sitemap-geraete.xml
sitemap https://www.teltarif.de/sitemap-info.xml
sitemap https://www.teltarif.de/sitemap-tarife.xml
Back to top

Comments

  • Ai Systeme exkludieren
  • https://netfuture.ch/2023/07/blocking-ai-crawlers-robots-txt-chatgpt/
  • All roboters may access everything, except certain cgi scripts:
  • Test: kann man damit alte urls loswerden? Pixel selbst enthalten ein noindex
  • Update 12.12.2023 - wieder abgeschaltet tauchen die alten jetzt wieder auf?
  • Fehler aussortiere ohne id!
  • Dito für inzwischen sehr alte Click-Urls (11/2023 ergänzt)
  • Diese gehen zu 99% auf 404 da die belegung deaktiviert
  • News-Slider der war versehentlich kurz unter /click/ - zugriff erlauben!
  • Beachte das /search/ nicht dabei ist die Suchmaschinen sollten
  • heute schlauer damit umgehen und es wird von google auch nicht mehr
  • empfohlen - weil die eigentlich allen Links folgen wollen.
  • Die seiten selbst haben ja ein noindex.
  • OB das aber wirklich sinnvoll ist müsste man mal abschließend klären
Back to top