unitpitt.ca
robots.txt

Robots Exclusion Standard data for unitpitt.ca

Resource Scan

Scan Details

Site Domain unitpitt.ca
Base Domain unitpitt.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-20T18:36:18+00:00
Next Scan 2025-12-04T18:36:18+00:00

Last Successful Scan

Scanned2025-10-12T13:27:28+00:00
URL https://unitpitt.ca/robots.txt
Redirect https://www.unitpitt.ca/robots.txt
Redirect Domain www.unitpitt.ca
Redirect Base unitpitt.ca
Domain IPs 192.250.237.70
Redirect IPs 192.250.237.70
Response IP 192.250.237.70
Found Yes
Hash d9a06260f6194c0630c2784303897be840ddae5adc1900faa5e929635ac0e139
SimHash e92088226fb3

Groups

*

Rule Path
Disallow /wp-content/uploads/wc-logs/
Disallow /wp-content/uploads/woocommerce_transient_files/
Disallow /wp-content/uploads/woocommerce_uploads/
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-content/uploads/media-from-ftp-tmp/

Other Records

Field Value
sitemap https://www.unitpitt.ca/sitemap.xml
sitemap https://www.unitpitt.ca/sitemap.rss