onilab.com
robots.txt
Robots Exclusion Standard data for onilab.com
Resource Scan
Scan Details
Site Domain | onilab.com |
Base Domain | onilab.com |
Scan Status | Ok |
Last Scan | 2024-05-25T18:24:27+00:00 |
Next Scan | 2024-06-24T18:24:27+00:00 |
Last Scan
Scanned | 2024-05-25T18:24:27+00:00 |
URL | https://onilab.com/robots.txt |
Domain IPs | 104.26.12.42, 104.26.13.42, 172.67.68.204, 2606:4700:20::681a:c2a, 2606:4700:20::681a:d2a, 2606:4700:20::ac43:44cc |
Response IP | 104.26.13.42 |
Found | Yes |
Hash | ae035338f2dbaedbed757cf219ccfa3526e8cdf6eca9cb3e855fd52008a4a29c |
SimHash | 416101208d94 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/l/email-protection |
Disallow | |
Disallow | /bags |
Disallow | /terms-of-service |
Disallow | /cookie-settings |
Disallow | *?utm |
Disallow | *?gclid= |
Disallow | */amp |
Disallow | *?wordfence_lh= |
Disallow | *?fl_rand_seed= |
Disallow | *?ob_source= |
Disallow | *?p=t |
Disallow | *?cat= |
Disallow | /blog/ma-$ |
Disallow | /blog/*/feed |
Disallow | *?ref= |
Disallow | */fdbfbf |
Disallow | */scsacasc |
Disallow | */sugarcrm |
Disallow | /blog/best-crm-for-magento-ecommerce-crm-integration-practices-to-reenergize-your-store/saleforce/ |
Disallow | */azxsx |
Disallow | */dfbbvd |
Disallow | /blog/magentogooglepagespeedinsightsoptimizationguide/.The |
Disallow | /blog/*tag |
Disallow | /*ssdx |
Disallow | /blog/how-to-implement-drone-delivery-service-for-the-ecommerce-store/vs-article-1280x848 |
Disallow | *?id=2 |
Disallow | */qqq |
Disallow | *?source=post_page |
Disallow | /blog/magento/migration$ |
Disallow | /blog/magento-2-performance-speed-optimization-guide/The |
Disallow | /blog/salesforce/salesforce-integration$ |
Disallow | /blog/how-to-implement-drone-delivery-service-for-the-ecommerce-store/drone-article-1280x848/ |
Disallow | /blog/magento/magento-pwa |
Disallow | /blog/ecommerce/pwa |
Disallow | /blog/salesforce/salesforce-others |
Disallow | /blog/ecommerce/ecommerce-others |
Allow | /uploads/blog/2020/05/amp_pages-583x1000-1.jpg |
Other Records
Field | Value |
---|---|
sitemap | https://onilab.com/sitemap.xml |
sitemap | https://onilab.com/blog-sitemap.xml |
Warnings
- `host` is not a known field.