charkit.com
robots.txt
Robots Exclusion Standard data for charkit.com
Resource Scan
Scan Details
Site Domain | charkit.com |
Base Domain | charkit.com |
Scan Status | Ok |
Last Scan | 2025-07-11T05:29:06+00:00 |
Next Scan | 2025-08-10T05:29:06+00:00 |
Last Scan
Scanned | 2025-07-11T05:29:06+00:00 |
URL | https://charkit.com/robots.txt |
Domain IPs | 192.124.249.185 |
Response IP | 192.124.249.185 |
Found | Yes |
Hash | 1f286e1e06d30d12a83d61ce0b55a08d7dfd8489acda3e92f5cd39d3d2ec11bf |
SimHash | 2a2c0845e0b8 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
*
Rule | Path |
---|---|
Disallow | /events/ |
Disallow | /wp-content/uploads/2023/06/LBB-Specialties-AIC-Dien-ERP-Communication.062023-2.pdf |
Disallow | /wp-content/uploads/2023/09/LBB-Specialties-ERP-Notification_091223-1.pdf |
Disallow | /symrise-innovation-day |
Disallow | /event/symrise-innovation-day |
Disallow | /wp-content/uploads/2023/10/API-Line-Card-101723.pdf |
Disallow | /wp-content/uploads/2023/10/Excipient-Line-Card-101723.pdf |
Disallow | /product-list-download/ |
Disallow | /*/principal/* |
Disallow | /lbbs-announces-new-go-to-market-strategy/ |
Disallow | /lbb-specialties-food-nutrition/ |
Disallow | /company-brief-download/ |
Disallow | /growth-blooms-video/ |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://www.lbbspecialties.com/sitemap_index.xml |
Comments