jetsobear.com
robots.txt

Robots Exclusion Standard data for jetsobear.com

Resource Scan

Scan Details

Site Domain jetsobear.com
Base Domain jetsobear.com
Scan Status Ok
Last Scan2024-09-22T09:31:57+00:00
Next Scan 2024-09-29T09:31:57+00:00

Last Scan

Scanned2024-09-22T09:31:57+00:00
URL https://jetsobear.com/robots.txt
Domain IPs 162.241.16.17
Response IP 162.241.16.17
Found Yes
Hash 8985c9b314df08551e56c8cd3fedd5c74925c4f8fc52b74b31a933f365761157
SimHash e30dc8428d92

Groups

*

Rule Path
Disallow /staging/
Disallow /wp-admin/
Disallow /extapm/
Allow /wp-admin/admin-ajax.php

trendictionbot

Rule Path
Disallow /

cogentbot

Rule Path
Disallow /

crowdtanglebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

mozilla/5.0 (compatible; tweetmemebot/3.0; +http://tweetmeme.com/)

Rule Path
Disallow /

mozilla/5.0 (compatible; grapeshotcrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)

Rule Path
Disallow /

Other Records

Field Value
sitemap https://jetsobear.com/sitemap_index.xml