nwslsoccer.com
robots.txt

Robots Exclusion Standard data for nwslsoccer.com

Resource Scan

Scan Details

Site Domain nwslsoccer.com
Base Domain nwslsoccer.com
Scan Status Ok
Last Scan2024-06-03T14:33:34+00:00
Next Scan 2024-07-03T14:33:34+00:00

Last Scan

Scanned2024-06-03T14:33:34+00:00
URL https://nwslsoccer.com/robots.txt
Redirect https://www.nwslsoccer.com/robots.txt
Redirect Domain www.nwslsoccer.com
Redirect Base nwslsoccer.com
Domain IPs 52.18.238.83
Redirect IPs 184.27.123.147, 184.27.123.242, 2600:1413:b000:14::b857:c14c, 2600:1413:b000:14::b857:c15b
Response IP 23.52.171.153
Found Yes
Hash b43b4352fded972c5d77c4813927c7c1067823992d25a8a78042de81e44e2b21
SimHash 61101454c993

Groups

*

Rule Path
Disallow /assets/
Disallow /_showcase/
Disallow /_libraries/
Disallow /errors/
Disallow /_test
Disallow /template
Disallow _mobileapp
Disallow /match/46d90ee908ed46e196f84b802de1437a

Other Records

Field Value
sitemap https://www.nwslsoccer.com/sitemap.xml
sitemap https://www.nwslsoccer.com/sitemap-article.xml