www5.javmost.com
robots.txt

Robots Exclusion Standard data for www5.javmost.com

Resource Scan

Scan Details

Site Domain www5.javmost.com
Base Domain javmost.com
Scan Status Ok
Last Scan2024-05-25T08:34:49+00:00
Next Scan 2024-06-24T08:34:49+00:00

Last Scan

Scanned2024-05-25T08:34:49+00:00
URL https://www5.javmost.com/robots.txt
Domain IPs 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59
Response IP 104.27.203.89
Found Yes
Hash fa0eba6ec99e6a4b8d54a0a1cb82c9299903718a8d7aeb33a7d92011eb6de858
SimHash 480c8870ff35

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path Comment
Allow *.css -
Allow *.js global

ahrefsbot

Rule Path
Allow /

redditbot/1.0

Rule Path
Allow *.jpg

Other Records

Field Value
sitemap https://www5.javmost.com/sitemapindex.xml

Comments

  • Googlebot