recruitinvietnam.com
robots.txt
Robots Exclusion Standard data for recruitinvietnam.com
Resource Scan
Scan Details
| Site Domain | recruitinvietnam.com |
| Base Domain | recruitinvietnam.com |
| Scan Status | Ok |
| Last Scan | 2024-10-04T01:05:06+00:00 |
| Next Scan | 2024-10-11T01:05:06+00:00 |
Last Scan
| Scanned | 2024-10-04T01:05:06+00:00 |
| URL | https://recruitinvietnam.com/robots.txt |
| Domain IPs | 104.21.27.13, 172.67.140.78, 2606:4700:3035::6815:1b0d, 2606:4700:3036::ac43:8c4e |
| Response IP | 104.21.27.13 |
| Found | Yes |
| Hash | c4946282a095ec3defe1458c8bda41d9211f4a0a4877b7baa6fdf815f6cc11da |
| SimHash | 50ac1533706a |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | / | - |
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /*/poll_avatar | - |
| Disallow | /*/poll_banner | - |
| Disallow | /*%3D%3D$ | - |
| Disallow | /*?*canvas_subclass= | - |
| Disallow | /*?*color= | - |
| Disallow | /*?*gender= | - |
| Disallow | /*?*product_id= | - |
| Disallow | /*?*query= | - |
| Disallow | /*?*scroll_id= | - |
| Disallow | /*?*sort= | - |
| Disallow | /404 | - |
| Disallow | /422 | - |
| Disallow | /500 | - |
| Disallow | /503 | - |
| Disallow | /cart | - |
| Disallow | /cdn-cgi/* | - |
| Disallow | /checkout | - |
| Disallow | /designs/*/edit | - |
| Disallow | /following | - |
| Disallow | /gift-ideas | - |
| Disallow | /gifting-module/* | - |
| Disallow | /header | - |
| Disallow | /kids-long-sleeve-t-shirt/* | - |
| Disallow | /kids-long-sleeve-t-shirts | - |
| Disallow | /kids-long-sleeve-t-shirts/* | - |
| Disallow | /laptop-case | - |
| Disallow | /laptop-case/* | - |
| Disallow | /my-store | - |
| Disallow | /new_campaign | - |
| Disallow | /notebook | - |
| Disallow | /notebook/* | - |
| Disallow | /stores/*/kids-long-sleeve-t-shirts | - |
| Disallow | /stores/*/laptop-case | - |
| Disallow | /stores/*/notebook | - |
| Disallow | /stores/*/totes | - |
| Disallow | /tote/* | - |
| Disallow | /totes | - |
| Disallow | /totes/* | - |
| Disallow | /stores/*/baby-bodysuits | - |
| Disallow | /baby-bodysuit/* | - |
| Disallow | /baby-bodysuits | - |
| Disallow | /baby-bodysuits/* | - |
| Disallow | /user/*/kids-long-sleeve-t-shirts | - |
| Disallow | /user/*/laptop-case | - |
| Disallow | /user/*/notebook | - |
| Disallow | /user/*/totes | - |
| Disallow | /user/*/baby-bodysuits | - |
| Disallow | /users/password | - |
| Disallow | /*US_CENSUS_NAME* | - |
| Disallow | /designs/*/canvas/*/also-available-products | - |
| Disallow | /designs/*/canvas/*/product_images | - |
| Disallow | /designs/*/canvas/*/similar_products | - |
| Disallow | /lazyload_cart_component_content | - |
| Disallow | /lazyload_cart_tray_content | - |
| Disallow | /lazyload_shop_tray_best_sellers_content | - |
| Disallow | /shop_designs_button | - |
| Disallow | /tray_trending_tags | - |
| Disallow | /ab-test/* | - |
| Disallow | /games/* | - |
| Disallow | /de/ | - |
| Disallow | /en-au/ | - |
| Disallow | /en-gb/ | - |
| Disallow | /es-mx/ | - |
| Disallow | /fr/ | - |
| Disallow | /it/ | - |
| Disallow | /pl/ | - |
| Disallow | /*/*sexy-bf* | - |
| Disallow | /*/*bf-sexy* | - |
| Disallow | /*/*sexybf* | - |
| Disallow | /*/*indian-bf* | - |
| Disallow | /*/*sexi-bf* | - |
| Disallow | /*/*baby-alien-porn* | - |
| Disallow | /*/*xxx14* | - |
| Disallow | /*/*bangladeshi-bf* | - |
| Disallow | /*/*xxx12* | - |
| Disallow | /*/*shemale-tube* | - |
| Disallow | /*/*sexy-bf* | - |
| Disallow | /*/*bf-video* | - |
| Disallow | /*/*xxx15* | - |
| Disallow | /*/*bangla-bf* | - |
| Disallow | /*/*bengali-bf* | - |
| Disallow | /*/*xxx13* | - |
| Disallow | /*/*bangladeshi-bf-bangladeshi-bf* | - |
| Disallow | /*/*baby-alien-porno* | - |
| Disallow | /*/*xxx8* | - |
| Disallow | /*/*bangla-bf-video* | - |
| Disallow | /*/*bf-sexy* | - |
| Disallow | /*/*cute-porn* | - |
| Disallow | /*/*xxx10* | - |
| Disallow | /*/*porn-baby-alien* | - |
| Disallow | /*/*hot-fuck* | - |
| Disallow | /*/*tamil-aunty* | - |
| Disallow | /*/*bf-bangladeshi* | - |
| Disallow | /*/*bf-bangla* | - |
| Disallow | /*/*big-boobs-porn* | - |
*
| Rule | Path |
|---|---|
| Allow | / |
mozilla/5.0 (windows nt 6.3; win64; x64) applewebkit/537.36 (khtml, like gecko) chrome/37.0.2049.0 safari/537.36
| Rule | Path |
|---|---|
| Disallow | / |
mozilla/5.0 (windows nt 6.3; wow64) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2226.0 safari/537.36
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 2 invalid lines.
Comments