selection.readersdigest.ca
robots.txt

Robots Exclusion Standard data for selection.readersdigest.ca

Resource Scan

Site Domain	selection.readersdigest.ca
Base Domain	readersdigest.ca
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Server returned a client error.
Last Scan	2024-05-02T03:05:36+00:00
Next Scan	2024-07-31T03:05:36+00:00

Scanned	2023-12-12T02:37:38+00:00
URL	https://selection.readersdigest.ca/robots.txt
Redirect	https://www.selection.ca/robots.txt
Redirect Domain	www.selection.ca
Redirect Base	selection.ca
Domain IPs	40.117.154.240
Redirect IPs	104.18.32.161, 172.64.155.95, 2606:4700:4400::6812:20a1, 2606:4700:4400::ac40:9b5f
Response IP	172.64.155.95
Found	Yes
Hash	91a76a28e493c69a7fc09607cfaddf1e600306aa5b5c42c970ce0b004fbc2a45
SimHash	6228df72ab17

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

No rules defined. All paths allowed.

Field	Value
crawl-delay	10

Field

Value

crawl-delay

10

Back to top

Field	Value
sitemap	https://www.selection.ca/sitemap_index.xml

Field

Value

sitemap

https://www.selection.ca/sitemap_index.xml

Back to top

This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
Robots.txt powered by the Virtual Robots.txt plugin

Back to top