revealinglies.com
robots.txt

Robots Exclusion Standard data for revealinglies.com

Resource Scan

Scan Details

Site Domain revealinglies.com
Base Domain revealinglies.com
Scan Status Ok
Last Scan2026-02-10T07:36:21+00:00
Next Scan 2026-02-17T07:36:21+00:00

Last Scan

Scanned2026-02-10T07:36:21+00:00
URL https://revealinglies.com/robots.txt
Redirect https://www.revealinglies.com/robots.txt
Redirect Domain www.revealinglies.com
Redirect Base revealinglies.com
Domain IPs 104.21.67.216, 172.67.181.99, 2606:4700:3032::ac43:b563, 2606:4700:3036::6815:43d8
Redirect IPs 104.21.67.216, 172.67.181.99, 2606:4700:3032::ac43:b563, 2606:4700:3036::6815:43d8
Response IP 172.67.181.99
Found Yes
Hash 01a28f8c1a5573a7952763420aec6ad46c37ea2806d327d1366a97cb3a376fdb
SimHash a254cb5349f0

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /application/
Disallow /financetracker/
Allow /uploads/
Allow /assets/themes/magazine/css/
Allow /assets/themes/magazine/js/
Allow *.css
Allow *.js
Allow *.webp
Disallow /?q=
Disallow */feed/
Disallow */comments/
Disallow */xmlrpc.php

Other Records

Field Value
sitemap https://www.revealinglies.com/sitemap.xml

Comments

  • Allow all search engines to crawl everything
  • This is good for a blog that wants maximum visibility
  • Block access to admin and private areas (if applicable)
  • Allow access to CSS and JS files for proper rendering
  • Block search and filter pages to avoid duplicate content
  • Sitemap location (replace with your actual sitemap URL)
  • Crawl delay (optional - only use if you have server performance issues)
  • Crawl-delay: 1