fr.eonline.com
robots.txt

Robots Exclusion Standard data for fr.eonline.com

Resource Scan

Scan Details

Site Domain fr.eonline.com
Base Domain eonline.com
Scan Status Ok
Last Scan2024-11-12T19:42:51+00:00
Next Scan 2024-11-19T19:42:51+00:00

Last Scan

Scanned2024-11-12T19:42:51+00:00
URL https://fr.eonline.com/robots.txt
Redirect https://www.eonline.com/robots.txt
Redirect Domain www.eonline.com
Redirect Base eonline.com
Domain IPs 23.215.7.25, 23.215.7.26
Redirect IPs 23.215.7.25, 23.215.7.26
Response IP 125.56.219.3
Found Yes
Hash 8478474314a6acee52b9ce33c0c0d12144e11e37eafb91fa2931e80ccb6130a3
SimHash 7005db5183a1

Groups

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler
peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

*

Rule Path
Allow /ads.txt
Disallow /ads
Disallow /robots/
Disallow /test.jsp
Disallow /actuator
Disallow /search
Disallow /ar/search
Disallow /br/search
Disallow /co/search
Disallow /mx/search
Disallow /ve/search
Disallow /uk/search
Disallow /ca/search
Disallow /au/search
Disallow /de/search
Disallow /fr/search
Disallow /ap/search

Other Records

Field Value
sitemap https://sitemaps.eonline.com/sitemaps/us/sitemap-index/sitemap-index.xml
sitemap https://sitemaps.eonline.com/sitemaps/ca/sitemap-index/sitemap-index.xml
sitemap https://sitemaps.eonline.com/sitemaps/us/sitemap-news/sitemap-news.xml
sitemap https://sitemaps.eonline.com/sitemaps/ca/sitemap-news/sitemap-news.xml

Comments

  • Disallow Bots