whites.net
robots.txt

Robots Exclusion Standard data for whites.net

Resource Scan

Scan Details

Site Domain whites.net
Base Domain whites.net
Scan Status Ok
Last Scan2024-10-19T21:26:34+00:00
Next Scan 2024-11-02T21:26:34+00:00

Last Scan

Scanned2024-10-19T21:26:34+00:00
URL https://whites.net/robots.txt
Redirect https://www.whites.net/robots.txt
Redirect Domain www.whites.net
Redirect Base whites.net
Domain IPs 35.190.95.30
Redirect IPs 104.18.30.208, 104.18.31.208, 2606:4700::6812:1ed0, 2606:4700::6812:1fd0
Response IP 104.18.31.208
Found Yes
Hash 2b9bddd3c0610d72e84305bab76869417cbe51a435038425455ac07ee5015a23
SimHash e0559c42c7c0

Groups

*

Rule Path
Disallow */search*
Disallow /admin*
Disallow */checkout*
Disallow /order*
Disallow /user*
Disallow /account*
Disallow /collections/*%2B*
Disallow /cart*

adsbot-google

Rule Path
Disallow /admin/*
Disallow /checkout/*
Disallow /cart/*

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.whites.net/sitemap.xml
sitemap https://www.whites.net/en/sitemap.xml