ctshop.rs
robots.txt
Robots Exclusion Standard data for ctshop.rs
Resource Scan
Scan Details
Site Domain | ctshop.rs |
Base Domain | ctshop.rs |
Scan Status | Ok |
Last Scan | 2024-10-03T01:34:00+00:00 |
Next Scan | 2024-11-02T01:34:00+00:00 |
Last Scan
Scanned | 2024-10-03T01:34:00+00:00 |
URL | https://ctshop.rs/robots.txt |
Redirect | https://www.ctshop.rs/robots.txt |
Redirect Domain | www.ctshop.rs |
Redirect Base | ctshop.rs |
Domain IPs | 178.63.126.253 |
Redirect IPs | 178.63.126.253 |
Response IP | 178.63.126.253 |
Found | Yes |
Hash | 622f37bcea943f45156b31012631158cff75bb961fbce728f4415d67c019a17e |
SimHash | 703d034becf2 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
bingbot
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
slurp
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
yandexbot
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
duckduckbot
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
baiduspider
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
twitterbot
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
pinterest
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
facebookexternalhit
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
facebookcatalog
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
meta-externalagent
Rule | Path |
---|---|
Disallow | */customer/* |
Disallow | */search/* |
Disallow | */proizvodi/* |
Disallow | /*.pdf$ |
Disallow | /*?*utm= |
Disallow | *?gclid= |
Disallow | */cart/* |
Disallow | /*?*pretrazi= |
Disallow | /*?*view= |
Disallow | /*?*page= |
Allow | */home/allcategories |
Allow | */js/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.ctshop.rs/sitemap.xml |
Warnings
- 12 invalid lines.