thelocal.ch
robots.txt

Robots Exclusion Standard data for thelocal.ch

Archived Snapshots

Resource Scan

Scan Details

Site Domain	thelocal.ch
Base Domain	thelocal.ch
Scan Status	Ok
Last Scan	2024-11-02T06:41:08+00:00
Next Scan	2024-11-09T06:41:08+00:00

Last Scan

Scanned	2024-11-02T06:41:08+00:00
URL	https://thelocal.ch/robots.txt
Redirect	https://www.thelocal.ch/robots.txt
Redirect Domain	www.thelocal.ch
Redirect Base	thelocal.ch
Domain IPs	104.18.6.208, 104.18.7.208, 2606:4700::6812:6d0, 2606:4700::6812:7d0
Redirect IPs	104.18.6.208, 104.18.7.208, 2606:4700::6812:6d0, 2606:4700::6812:7d0
Response IP	104.18.7.208
Found	Yes
Hash	525075dfad4d45b047135fb943dbf4094694cf388d6bb7399b2de3b11a32d879
SimHash	5d0d52518f80

Groups

*

Rule	Path
Disallow	.js
Disallow	.css
Disallow	/200*
Disallow	/2010*
Disallow	/2011*
Disallow	/2012*
Disallow	/2013*
Disallow	/amp*
Disallow	/fonts*
Disallow	/index.php/
Disallow	cms.
Disallow	medium.
Disallow	medium2.
Disallow	discuss.

Rule

Path

Disallow

*.js*

Disallow

*.css*

Disallow

/200*

Disallow

/2010*

Disallow

/2011*

Disallow

/2012*

Disallow

/2013*

Disallow

/amp*

Disallow

/fonts*

Disallow

/index.php/

Disallow

*cms.*

Disallow

*medium.*

Disallow

*medium2.*

Disallow

*discuss.*

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

arquivo-web-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

awariorssbot
awariosmartbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot-web

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

jenkersbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeek

Rule	Path
Disallow	/

Rule

Path

Disallow

moodlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

newsnow

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

omgilibot

Rule	Path
Disallow	/

Rule

Path

Disallow

peer39_crawler
peer39_crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekr

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

youbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yacy

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.thelocal.at/sitemap/at/news.xml
sitemap	https://www.thelocal.at/sitemap/index.xml

Field

Value

sitemap

https://www.thelocal.at/sitemap/at/news.xml

sitemap

https://www.thelocal.at/sitemap/index.xml

thelocal.chrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

gptbot

chatgpt-user

ccbot

ahrefsbot

archive.org_bot

arquivo-web-crawler

amazonbot

anthropic-ai

awariorssbotawariosmartbot

bytespider

coccocbot-web

claudebot

claude-web

dataforseobot

facebookbot

ia_archiver

jenkersbot

mojeek

moodlebot

magpie-crawler

newsnow

omgili

omgilibot

peer39_crawlerpeer39_crawler/1.0

perplexitybot

petalbot

seekr

seznambot

turnitinbot

youbot

yacy

yandex

Other Records

thelocal.ch
robots.txt

awariorssbot
awariosmartbot

peer39_crawler
peer39_crawler/1.0