canada247.info
robots.txt

Robots Exclusion Standard data for canada247.info

Resource Scan

Scan Details

Site Domain canada247.info
Base Domain canada247.info
Scan Status Ok
Last Scan2024-10-11T08:11:17+00:00
Next Scan 2024-10-18T08:11:17+00:00

Last Scan

Scanned2024-10-11T08:11:17+00:00
URL https://canada247.info/robots.txt
Domain IPs 5.9.67.62
Response IP 5.9.67.62
Found Yes
Hash 51cfe227a117d56bf65ad2f216f9906b4e098e9c8f853fc94c9990702b78737a
SimHash c10c59a0ea19

Groups

*

Rule Path
Disallow /redirect*
Disallow /edit*
Disallow *path%3D*
Disallow */ajax/*
Disallow *tag%3D*
Disallow *show%3D*
Disallow *what%3D*
Disallow *forgot_password
Disallow *where%3D*
Allow /

ahrefsbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://canada247.info/sitemap.xml

Comments

  • Block MegaIndex.ru
  • Block Baidu
  • Block Youdao
  • Block Majestic

Warnings

  • 1 invalid line.