multiable.com
robots.txt

Robots Exclusion Standard data for multiable.com

Resource Scan

Scan Details

Site Domain multiable.com
Base Domain multiable.com
Scan Status Ok
Last Scan2025-06-24T12:21:07+00:00
Next Scan 2025-07-08T12:21:07+00:00

Last Scan

Scanned2025-06-24T12:21:07+00:00
URL https://multiable.com/robots.txt
Redirect https://www.multiable.com/robots.txt/
Redirect Domain www.multiable.com
Redirect Base multiable.com
Domain IPs 104.26.2.56, 104.26.3.56, 172.67.71.24, 2606:4700:20::681a:238, 2606:4700:20::681a:338, 2606:4700:20::ac43:4718
Redirect IPs 104.26.2.56, 104.26.3.56, 172.67.71.24, 2606:4700:20::681a:238, 2606:4700:20::681a:338, 2606:4700:20::ac43:4718
Response IP 104.26.2.56
Found Yes
Hash b61b0c25bbdbb5c7bc15372e3f23ea9b6d84bdb35fd0fba7ae0b113dee7f26fc
SimHash 4c967cf3d4b1

Groups

*

Rule Path
Allow /
Allow /
Allow /sitemap.xml
Disallow /admin/
Disallow /redirection/
Disallow /tdk/
Disallow /api/
Disallow /search?
Disallow /*?*
Allow /erp/
Allow /hcm/
Allow /crm/
Allow /wms/
Allow /dms/
Allow /artificial-intelligence/
Allow /industries/
Allow /knowledge/
Allow /customers/
Allow /news/
Allow /contact/
Allow /about/
Allow /careers/
Allow /zh/
Allow /aerospace/
Allow /automotive/
Allow /biotech/
Allow /chemical/
Allow /clothing-textile/
Allow /construction/
Allow /consumer-products/
Allow /cosmetics/
Allow /electrical-appliances/
Allow /electronics/
Allow /electroplating/
Allow /engineering-maintenance/
Allow /fashion/
Allow /financial-services/
Allow /fmcg/
Allow /food-beverage/
Allow /food-beverages/
Allow /fresh-food/
Allow /furniture/
Allow /hardware-metalworking/
Allow /healthcare/
Allow /hospitality-leisure/
Allow /ict/
Allow /import-export/
Allow /injection-moulding/
Allow /logistics/
Allow /luxury/
Allow /machinery/
Allow /manufacturing/
Allow /maritime-ship-repair/
Allow /metal-metalworking/
Allow /natural-gas/
Allow /ngo/
Allow /palm-oil/
Allow /pet-care/
Allow /plastics/
Allow /printing-packaging/
Allow /property-management/
Allow /renewable-energy/
Allow /retail/
Allow /rubber/
Allow /sportswear/
Allow /toy/
Allow /travel-tourism/
Allow /wholesale/

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://multiable.com/sitemap.xml

Comments

  • Allow all search engines to crawl the website
  • Disallow admin and management areas
  • Disallow search results and dynamic pages
  • Allow specific important pages
  • Allow all industry pages
  • Crawl-delay for respectful crawling
  • Sitemap location