thejbt.com
robots.txt

Robots Exclusion Standard data for thejbt.com

Resource Scan

Scan Details

Site Domain thejbt.com
Base Domain thejbt.com
Scan Status Ok
Last Scan2024-11-13T21:34:32+00:00
Next Scan 2024-11-20T21:34:32+00:00

Last Scan

Scanned2024-11-13T21:34:32+00:00
URL https://thejbt.com/robots.txt
Redirect https://www.thejbt.com/robots.txt
Redirect Domain www.thejbt.com
Redirect Base thejbt.com
Domain IPs 104.26.4.213, 104.26.5.213, 172.67.70.210, 2606:4700:20::681a:4d5, 2606:4700:20::681a:5d5, 2606:4700:20::ac43:46d2
Redirect IPs 104.26.4.213, 104.26.5.213, 172.67.70.210, 2606:4700:20::681a:4d5, 2606:4700:20::681a:5d5, 2606:4700:20::ac43:46d2
Response IP 104.26.5.213
Found Yes
Hash cda4a7411b8113ddb788f3cd4d4708b788fa3be14586e1cf8610a63921499a56
SimHash 0109c8534733

Groups

*

Rule Path
Allow /
Disallow /search?title=*

Other Records

Field Value
sitemap https://www.thejbt.com/sitemap-news.xml
sitemap https://www.thejbt.com/sitemap-category.xml
sitemap https://www.thejbt.com/sitemap-image.xml