lenouvelliste.ch
robots.txt

Robots Exclusion Standard data for lenouvelliste.ch

Resource Scan

Scan Details

Site Domain lenouvelliste.ch
Base Domain lenouvelliste.ch
Scan Status Ok
Last Scan2024-09-26T16:03:54+00:00
Next Scan 2024-10-03T16:03:54+00:00

Last Scan

Scanned2024-09-26T16:03:54+00:00
URL https://lenouvelliste.ch/robots.txt
Redirect https://www.lenouvelliste.ch/robots.txt
Redirect Domain www.lenouvelliste.ch
Redirect Base lenouvelliste.ch
Domain IPs 195.15.210.141, 2001:1600:13:100:f816:3eff:fee3:b361
Redirect IPs 195.15.210.141
Response IP 195.15.210.141
Found Yes
Hash fd07e22b40aa35dd5d73354ed5c90392df34dfebb966b642c104ad31147d71a3
SimHash 603cc9408215

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

*

Rule Path
Disallow
Allow /

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /api/*
Disallow /flash-monde/*
Disallow /flash-suisse/*
Disallow /flash-sport/*

Other Records

Field Value
sitemap https://www.lenouvelliste.ch/sitemap.xml