compufirst.com
robots.txt
Robots Exclusion Standard data for compufirst.com
Resource Scan
Scan Details
| Site Domain | compufirst.com |
| Base Domain | compufirst.com |
| Scan Status | Ok |
| Last Scan | 2025-10-10T16:55:18+00:00 |
| Next Scan | 2025-11-09T16:55:18+00:00 |
Last Scan
| Scanned | 2025-10-10T16:55:18+00:00 |
| URL | https://www.compufirst.com/robots.txt |
| Domain IPs | 185.104.174.216 |
| Response IP | 185.104.174.216 |
| Found | Yes |
| Hash | 93d2d830f226187b2ab9fc028ab4b5e19f01eee8b2f00996340c5d49eaf93d1c |
| SimHash | 22de7ec0c4b9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | / |
googlebot
adsbot-google
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
adsbot-google
adsbot-google-mobile
storebot-google
bingbot
bingpreview
msnbot
msnbot-media
twengabot-2.0
twitterbot
linkedinbot
facebookexternalhit
applebot
qwantify
duckduckbot
botify
slurp
siteauditbot-mobile
siteauditbot-desktop
googlebot-mobile
googlebot-desktop
semrushbot
siteauditbot
| Product | Comment |
|---|---|
| googlebot | moteur de recherche |
| googlebot-image | moteur de recherche d'images |
| googlebot-news | moteur de recherche d'images |
| slurp | Yahoo |
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
semrushbot-si
| Rule | Path |
|---|---|
| Allow | / |
| Allow | / |
| Disallow | /system/ |
| Disallow | /compte/ |
| Disallow | /order/ |
| Disallow | /cadmin/ |
| Disallow | /track/ |
| Disallow | /premium/ |
| Disallow | /shop/ |
| Disallow | /systemlogged/ |
| Disallow | *pMini* |
| Disallow | *pMax* |
| Disallow | *orderType* |
| Disallow | *orderField* |
| Disallow | *pageType* |
| Disallow | *cb_onglet* |
| Disallow | *cb_menu* |
| Disallow | *cb_submenu* |
| Disallow | *stickerId* |
| Disallow | *field0* |
| Disallow | *field1* |
| Disallow | *newSearch* |
| Disallow | *field2* |
| Disallow | *field3* |
| Disallow | *field4* |
| Disallow | *field5* |
| Disallow | *field6* |
| Allow | */compte/account_new.do* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.compufirst.com/sitemapindex.xml |
Comments