jfrog.info
robots.txt

Robots Exclusion Standard data for jfrog.info

Resource Scan

Scan Details

Site Domain jfrog.info
Base Domain jfrog.info
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-05T14:09:28+00:00
Next Scan 2024-12-04T14:09:28+00:00

Last Successful Scan

Scanned2023-11-03T08:42:43+00:00
URL https://jfrog.info/robots.txt
Domain IPs 13.227.254.100, 13.227.254.121, 13.227.254.53, 13.227.254.63
Response IP 13.227.254.63
Found Yes
Hash e7aa2f7aaa3fcbd41e19c78589b4d892d0b340202392edc8eb8db1ee46becc9b
SimHash 294a958386e7

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-content/cache
Disallow /readme.html
Disallow /licence.txt
Disallow /wp-config-sample.php
Disallow /wp-comments-post.php
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /jira/
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.pdf

Other Records

Field Value
sitemap https://jfrog.com/sitemap_index.xml