nwslsoccer.com
robots.txt
Robots Exclusion Standard data for nwslsoccer.com
Resource Scan
Scan Details
Site Domain | nwslsoccer.com |
Base Domain | nwslsoccer.com |
Scan Status | Ok |
Last Scan | 2024-06-03T14:33:34+00:00 |
Next Scan | 2024-07-03T14:33:34+00:00 |
Last Scan
Scanned | 2024-06-03T14:33:34+00:00 |
URL | https://nwslsoccer.com/robots.txt |
Redirect | https://www.nwslsoccer.com/robots.txt |
Redirect Domain | www.nwslsoccer.com |
Redirect Base | nwslsoccer.com |
Domain IPs | 52.18.238.83 |
Redirect IPs | 184.27.123.147, 184.27.123.242, 2600:1413:b000:14::b857:c14c, 2600:1413:b000:14::b857:c15b |
Response IP | 23.52.171.153 |
Found | Yes |
Hash | b43b4352fded972c5d77c4813927c7c1067823992d25a8a78042de81e44e2b21 |
SimHash | 61101454c993 |
Groups
*
Rule | Path |
---|---|
Disallow | /assets/ |
Disallow | /_showcase/ |
Disallow | /_libraries/ |
Disallow | /errors/ |
Disallow | /_test |
Disallow | /template |
Disallow | _mobileapp |
Disallow | /match/46d90ee908ed46e196f84b802de1437a |
Other Records
Field | Value |
---|---|
sitemap | https://www.nwslsoccer.com/sitemap.xml |
sitemap | https://www.nwslsoccer.com/sitemap-article.xml |