collegefashion.net
robots.txt
Robots Exclusion Standard data for collegefashion.net
Resource Scan
Scan Details
Site Domain | collegefashion.net |
Base Domain | collegefashion.net |
Scan Status | Ok |
Last Scan | 2024-09-18T13:00:08+00:00 |
Next Scan | 2024-09-25T13:00:08+00:00 |
Last Scan
Scanned | 2024-09-18T13:00:08+00:00 |
URL | https://collegefashion.net/robots.txt |
Domain IPs | 104.21.19.251, 172.67.190.181, 2606:4700:3034::6815:13fb, 2606:4700:3036::ac43:beb5 |
Response IP | 104.21.19.251 |
Found | Yes |
Hash | d986fc37bbcf950e075fe877872116776a12e14ea7201d9cc2a724e07ece86df |
SimHash | c3bcc842a2b3 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-content/uploads/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /tag/ |
Disallow | /go/* |
Disallow | /page/ |
Disallow | /components/ |
Disallow | /search/ |
Disallow | /link.php |
Disallow | /comment-page$ |
Disallow | /*.amp$ |
Disallow | /?utm$ |
Other Records
Field | Value |
---|---|
sitemap | https://www.collegefashion.net/sitemap_index.xml |