wicz.com
robots.txt

Robots Exclusion Standard data for wicz.com

Resource Scan

Scan Details

Site Domain wicz.com
Base Domain wicz.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-15T12:23:27+00:00
Next Scan 2024-06-22T12:23:27+00:00

Last Successful Scan

Scanned2024-06-07T12:22:48+00:00
URL https://wicz.com/robots.txt
Redirect https://www.wicz.com/robots.txt
Redirect Domain www.wicz.com
Redirect Base wicz.com
Domain IPs 100.25.172.61, 54.145.205.131
Redirect IPs 104.18.30.13, 104.18.31.13, 2606:4700::6812:1e0d, 2606:4700::6812:1f0d
Response IP 104.18.31.13
Found Yes
Hash 57e126ebc40ae93bb451402d23d13ac1755e159b0d234fb91f00245ef71ef2a7
SimHash 4db55f6c3bdb

Groups

*

Rule Path
Disallow /ads/
Disallow /global/tools/
Disallow /global/interfaces/
Disallow /global/images/
Disallow /global/include/
Disallow /global/applications/
Disallow /global/pm/
Disallow /global/utilities/
Disallow /global/reports/
Disallow /global/video/
Disallow /applications/
Disallow /cgi-bin/
Disallow /classifieds/
Disallow /default_files/
Disallow /images/
Disallow /include/
Disallow /incoming/
Disallow /reports/
Disallow /professionalservices/
Disallow /search
Disallow /temp/
Disallow /trafficcam/
Disallow /traffic/
Disallow /contentmgmt/
Disallow /register
Disallow /login
Disallow /forgot-password
Disallow /reset-password
Disallow /profile

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.wicz.com/sitemap.xml.gz
sitemap https://www.wicz.com/sitemap-pages.xml.gz
sitemap https://www.wicz.com/newssitemap.xml.gz
sitemap https://www.wicz.com/videositemap.xml.gz
sitemap https://www.wicz.com/sitemap-pr-stories.xml.gz