jbtc.com
robots.txt

Robots Exclusion Standard data for jbtc.com

Resource Scan

Scan Details

Site Domain jbtc.com
Base Domain jbtc.com
Scan Status Ok
Last Scan2024-09-27T14:18:46+00:00
Next Scan 2024-10-27T14:18:46+00:00

Last Scan

Scanned2024-09-27T14:18:46+00:00
URL https://jbtc.com/robots.txt
Redirect https://www.jbtc.com/robots.txt
Redirect Domain www.jbtc.com
Redirect Base jbtc.com
Domain IPs 141.193.213.20, 141.193.213.21
Redirect IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash ea95a96df69e776bcce159b8fd40ffa551d9f812478abe5c0ecbe8f9290c17e2
SimHash 69ad98548fe2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /anti-bribery/
Disallow /-/media/
Disallow /poultry-processing/
Allow /wp-admin/admin-ajax.php

semrushbot-sa

Rule Path
Allow /

googlebot

Rule Path
Disallow /*automated-systems/resources-and-support/system-updates/tim-software
Disallow /*foodtech/products-and-solutions/brands/a-and-b-process-systems/recent-projects

bingbot

Rule Path
Disallow /*automated-systems/resources-and-support/system-updates/tim-software
Disallow /*foodtech/products-and-solutions/brands/a-and-b-process-systems/recent-projects

Other Records

Field Value
sitemap https://www.jbtc.com/sitemap_index.xml
sitemap https://www.jbtc.com/foodtech/sitemap_index.xml
sitemap https://www.jbtc.com/automated-systems/sitemap_index.xml