mobile2.lematin.ch
robots.txt

Robots Exclusion Standard data for mobile2.lematin.ch

Resource Scan

Scan Details

Site Domain mobile2.lematin.ch
Base Domain lematin.ch
Scan Status Ok
Last Scan2024-06-27T18:38:29+00:00
Next Scan 2024-07-04T18:38:29+00:00

Last Scan

Scanned2024-06-27T18:38:29+00:00
URL https://mobile2.lematin.ch/robots.txt
Redirect https://www.lematin.ch/robots.txt
Redirect Domain www.lematin.ch
Redirect Base lematin.ch
Domain IPs 2600:9000:21fa:1c00:1f:524a:7080:93a1, 2600:9000:21fa:3200:1f:524a:7080:93a1, 2600:9000:21fa:4400:1f:524a:7080:93a1, 2600:9000:21fa:9a00:1f:524a:7080:93a1, 2600:9000:21fa:ae00:1f:524a:7080:93a1, 2600:9000:21fa:b800:1f:524a:7080:93a1, 2600:9000:21fa:bc00:1f:524a:7080:93a1, 2600:9000:21fa:e00:1f:524a:7080:93a1, 65.9.112.29, 65.9.112.41, 65.9.112.67, 65.9.112.8
Redirect IPs 18.161.6.114, 18.161.6.116, 18.161.6.32, 18.161.6.69, 2600:9000:2475:2600:1f:1b2a:2300:93a1, 2600:9000:2475:2a00:1f:1b2a:2300:93a1, 2600:9000:2475:2e00:1f:1b2a:2300:93a1, 2600:9000:2475:3000:1f:1b2a:2300:93a1, 2600:9000:2475:3c00:1f:1b2a:2300:93a1, 2600:9000:2475:4200:1f:1b2a:2300:93a1, 2600:9000:2475:d400:1f:1b2a:2300:93a1, 2600:9000:2475:e600:1f:1b2a:2300:93a1
Response IP 18.165.171.32
Found Yes
Hash 29ff1dcdb29497f9cb45fada49cc25a0dca5a114ab37f1ad43b3b8fda023068e
SimHash 6000ca7a2761

Groups

*

Rule Path
Disallow /cmd/
Disallow /*comment/
Disallow /*.json
Allow /_next/static/media/*svg
Disallow /_next/static/media/
Disallow /search

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.lematin.ch/sitemaps/fr/videos.xml
sitemap https://www.lematin.ch/sitemaps/fr/news.xml
sitemap https://www.lematin.ch/sitemaps/fr/articles.xml
sitemap https://www.lematin.ch/sitemaps/fr/navigation.xml

Comments

  • Updated Feb 2024