cartiguru.com
robots.txt
Robots Exclusion Standard data for cartiguru.com
Resource Scan
Scan Details
| Site Domain | cartiguru.com |
| Base Domain | cartiguru.com |
| Scan Status | Ok |
| Last Scan | 2025-03-15T22:05:04+00:00 |
| Next Scan | 2025-04-14T22:05:04+00:00 |
Last Scan
| Scanned | 2025-03-15T22:05:04+00:00 |
| URL | https://cartiguru.com/robots.txt |
| Domain IPs | 2a02:4780:15:ea75:d302:2dd6:bdc4:76dc, 84.32.84.148 |
| Response IP | 77.37.115.150 |
| Found | Yes |
| Hash | 9e8bff35bf7fa264a6ef66c181f485244e9fe496cb5ca03e8ea6b218289efdaa |
| SimHash | 48be5d43e6a2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Disallow | /tag/ |
| Disallow | /page/ |
| Disallow | /page/*/?s= |
| Disallow | /*?page= |
| Disallow | /amp/ |
| Disallow | /*?amp= |
| Disallow | /rss/ |
| Disallow | /category/feed/ |
| Disallow | /tag/feed/ |
| Disallow | /*?feed= |
| Disallow | /wp-json/ |
| Disallow | /?rest_route= |
| Disallow | /*.htm$ |
| Disallow | /*.html$ |
| Disallow | /wp-login.php?* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
| Allow | /*.webp$ |
| Allow | /*.svg$ |
googlebot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
bingbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
oai searchbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
gptbot
| Rule | Path |
|---|---|
| Disallow | */feed/ |
| Disallow | /feed/$ |
| Disallow | /*? |
| Disallow | /*?= |
| Disallow | /search/ |
| Disallow | *?s=* |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.jpg |
| Allow | /*.png$ |
| Allow | /*.jpeg$ |
| Allow | /*.gif$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.cartiguru.com/sitemap.xml |
| sitemap | https://www.cartiguru.com/post-sitemap.xml |
Comments