citywire.ch
robots.txt

Robots Exclusion Standard data for citywire.ch

Resource Scan

Scan Details

Site Domain citywire.ch
Base Domain citywire.ch
Scan Status Ok
Last Scan2024-06-25T22:15:34+00:00
Next Scan 2024-07-25T22:15:34+00:00

Last Scan

Scanned2024-06-25T22:15:34+00:00
URL https://citywire.ch/robots.txt
Redirect https://citywire.com:443/ch/robots.txt
Redirect Domain citywire.com
Redirect Base citywire.com
Domain IPs 18.200.165.77, 52.211.201.149, 52.212.126.238
Redirect IPs 45.60.242.95, 45.60.248.95
Response IP 45.60.242.95
Found Yes
Hash d00b9754057e5a9cbe77dec2391362cc24fa58f8e848d5b945c5d8a5d2418116
SimHash 1c524341e010

Groups

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

moodlebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

https://hada.news

Rule Path
Disallow /

https://www.imediaethics.org

Rule Path
Disallow /

mojeek

Rule Path
Disallow /

jenkersbot

Rule Path
Disallow /

seekr

Rule Path
Disallow /

turnitin

Rule Path
Disallow /

youbot

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

yacy

Rule Path
Disallow /

yandex

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

*

Rule Path
Disallow /search$
Disallow /*/search$
Disallow /search?
Disallow /*/search?
Disallow /sign-in$
Disallow /*/sign-in$
Disallow /sign-in?
Disallow /*/sign-in?
Disallow /register$
Disallow /*/register$
Disallow /register?
Disallow /*/register?
Disallow /redirect$
Disallow /*/redirect$
Disallow /redirect?
Disallow /*/redirect?
Disallow /GetCommentsCount
Disallow /*/GetCommentsCount
Disallow /GetCommentsCount?
Disallow /*/GetCommentsCount?