conservative.ca
robots.txt

Robots Exclusion Standard data for conservative.ca

Resource Scan

Scan Details

Site Domain conservative.ca
Base Domain conservative.ca
Scan Status Ok
Last Scan2024-09-19T20:57:42+00:00
Next Scan 2024-10-19T20:57:42+00:00

Last Scan

Scanned2024-09-19T20:57:42+00:00
URL https://conservative.ca/robots.txt
Domain IPs 104.20.14.9, 104.20.15.9, 172.67.3.145, 2606:4700:10::6814:e09, 2606:4700:10::6814:f09, 2606:4700:10::ac43:391
Response IP 104.20.14.9
Found Yes
Hash 60de2fcd803f8c7f48a9a709d85583d5fcb9b4f1efb7a84b4c3be3535ff44b72
SimHash 69109339cf63

Groups

*

Rule Path
Disallow /4eCzx72_Gh

*

Rule Path
Disallow /cce-graphics

bbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot/3.0

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

yeti

Rule Path
Disallow /

snapbot/1.0

Rule Path
Disallow /
Disallow /active-landing-pages

twitterbot

Rule Path
Disallow *
Allow /wp-content

googlebot

Rule Path
Disallow /nogooglebot/

*

Rule Path
Allow /

amazonbot

Rule Path
Disallow *

applebot

Rule Path
Disallow *

Other Records

Field Value
sitemap https://www.conservative.ca/sitemap.xml

Comments

  • Group 1
  • Group 2
  • Amazon's bot
  • Apples bot