sparkjop.no
robots.txt

Robots Exclusion Standard data for sparkjop.no

Resource Scan

Scan Details

Site Domain sparkjop.no
Base Domain sparkjop.no
Scan Status Ok
Last Scan2025-08-29T02:37:50+00:00
Next Scan 2025-09-28T02:37:50+00:00

Last Scan

Scanned2025-08-29T02:37:50+00:00
URL https://sparkjop.no/robots.txt
Redirect https://www.sparkjop.no/robots.txt
Redirect Domain www.sparkjop.no
Redirect Base sparkjop.no
Domain IPs 194.63.248.52, 2a01:5b40:0:248::52
Redirect IPs 13.50.80.82, 16.16.134.33
Response IP 16.16.134.33
Found Yes
Hash 27586ac46cb282b7e6d380030efcf892d67fb2a71b651cff9883011cbd7b1489
SimHash cb26dc0bc193

Groups

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /index.php/
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /app/
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /catalog/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalogsearch/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?nosto=*
Disallow /backinstocksubscribe/
Disallow /customer/account/login/referer/
Disallow /login/referer/*
Disallow /productalert/
Disallow /test-side

Other Records

Field Value
sitemap https://www.sparkjop.no/media/sitemap.xml