Log In Sign Up

www2016.ca
robots.txt

Robots Exclusion Standard data for www2016.ca

Resource Scan

Scan Details

Site Domain www2016.ca
Base Domain www2016.ca
Scan Status Ok
Last Scan2025-08-03T01:03:17+00:00
Next Scan 2025-09-02T01:03:17+00:00

Last Scan

Scanned2025-08-03T01:03:17+00:00
URL https://www2016.ca/robots.txt
Domain IPs 104.21.25.137, 172.67.134.71, 2606:4700:3033::6815:1989, 2606:4700:3033::ac43:8647
Response IP 172.67.134.71
Found Yes
Hash 0d150aa57bffe4cf41c9c79c7247e97d6ac5c68b4e6b71bf33566937f4447dbb
SimHash 4135c6827313

Groups

semrushbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

microsofturl

Rule Path
Disallow /

mazbot

Rule Path
Disallow /

webviewer

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

iria

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

semrushbot/1.1~bl

Rule Path
Disallow /

pulno

Rule Path
Disallow /

websauger

Rule Path
Disallow /

demandbasepublisheranalyzer

Rule Path
Disallow /

indylibrary

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Disallow /payment
Disallow /fast/*
Allow /wp-admin/admin-ajax.php
Back to top