tawfeer.nl
robots.txt

Robots Exclusion Standard data for tawfeer.nl

Resource Scan

Scan Details

Site Domain tawfeer.nl
Base Domain tawfeer.nl
Scan Status Ok
Last Scan2024-10-26T05:10:26+00:00
Next Scan 2024-11-02T05:10:26+00:00

Last Scan

Scanned2024-10-26T05:10:26+00:00
URL https://tawfeer.nl/robots.txt
Redirect https://www.tawfeer.nl/robots.txt
Redirect Domain www.tawfeer.nl
Redirect Base tawfeer.nl
Domain IPs 35.190.95.30
Redirect IPs 104.18.30.208, 104.18.31.208, 2606:4700::6812:1ed0, 2606:4700::6812:1fd0
Response IP 104.18.30.208
Found Yes
Hash ec364d4df9600f4aa399c35cecfd4a08bf2d3c71c23e8e822ede35176973e1d8
SimHash 85315a408d13

Groups

*

Rule Path
Disallow /admin
Disallow /checkout
Disallow /order
Disallow /user
Disallow /account
Disallow /collections/*%2B*
Disallow /cart

adsbot-google

Rule Path
Disallow /admin
Disallow /checkout
Disallow /cart

nutch

Rule Path
Disallow /

Other Records

Field Value
sitemap https://tawfeer.nl/sitemap.xml '