freeproxy.ca
robots.txt

Robots Exclusion Standard data for freeproxy.ca

Resource Scan

Scan Details

Site Domain freeproxy.ca
Base Domain freeproxy.ca
Scan Status Ok
Last Scan2025-09-02T14:48:53+00:00
Next Scan 2025-10-02T14:48:53+00:00

Last Scan

Scanned2025-09-02T14:48:53+00:00
URL https://freeproxy.ca/robots.txt
Redirect https://www.freeproxy.ca/robots.txt
Redirect Domain www.freeproxy.ca
Redirect Base freeproxy.ca
Domain IPs 104.21.95.54, 172.67.143.71, 2606:4700:3035::ac43:8f47, 2606:4700:3037::6815:5f36
Redirect IPs 104.21.95.54, 172.67.143.71, 2606:4700:3035::ac43:8f47, 2606:4700:3037::6815:5f36
Response IP 172.67.143.71
Found Yes
Hash 1a6813f5f9f7ef0476f828ef091bcf252a3f37d46b6e3ffc819a0e0f9eeb5bff
SimHash 104d90226f32

Groups

semrushbot

Rule Path
Disallow /

scooter

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webimagecollector

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

valet

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

webminer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /*/download/thankyou.aspx?
Allow /wp-admin/admin-ajax.php