jfeed.com
robots.txt

Robots Exclusion Standard data for jfeed.com

Resource Scan

Scan Details

Site Domain jfeed.com
Base Domain jfeed.com
Scan Status Ok
Last Scan2025-10-16T03:38:54+00:00
Next Scan 2025-10-23T03:38:54+00:00

Last Scan

Scanned2025-10-16T03:38:54+00:00
URL https://jfeed.com/robots.txt
Redirect https://www.jfeed.com/robots.txt
Redirect Domain www.jfeed.com
Redirect Base jfeed.com
Domain IPs 76.76.21.21
Redirect IPs 66.33.60.67, 76.76.21.164
Response IP 76.76.21.61
Found Yes
Hash 47259b63daf0add16f8718679d7d823535ff4f8ccc48514c54cb95a9d070c2b2
SimHash 206aff7dcc41

Groups

*

Rule Path
Disallow /admin/
Disallow /scripts/
Disallow /api/
Disallow /*.js.map$
Disallow /*.css.map$
Allow /

Other Records

Field Value
sitemap https://www.jfeed.com/sitemap.xml
sitemap https://www.jfeed.com/sitemap-news.xml

Comments

  • Block access to admin pages and internal scripts
  • Disallow crawling of source map files (for debugging, not needed by crawlers)
  • Specify the sitemap location