takrails.no
robots.txt

Robots Exclusion Standard data for takrails.no

Resource Scan

Scan Details

Site Domain takrails.no
Base Domain takrails.no
Scan Status Ok
Last Scan2024-05-09T12:28:12+00:00
Next Scan 2024-06-08T12:28:12+00:00

Last Scan

Scanned2024-05-09T12:28:12+00:00
URL https://takrails.no/robots.txt
Domain IPs 104.26.10.122, 104.26.11.122, 172.67.70.51, 2606:4700:20::681a:a7a, 2606:4700:20::681a:b7a, 2606:4700:20::ac43:4633
Response IP 104.26.10.122
Found Yes
Hash aaf924d381443003f09424d87d01497b1810efae27bef27cb0b12aa7c4e71e56
SimHash 4934b914e130

Groups

amazonbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /catalogsearch

googlebot-image

Rule Path
Disallow /catalogsearch

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

*

Rule Path
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /tag/
Disallow /cache/
Disallow /cdn-cgi/
Disallow /sales/

Other Records

Field Value
sitemap https://takrails.no/sitemaps/takrails/sitemap.xml