Log In Sign Up

databeautifier.com
robots.txt

Robots Exclusion Standard data for databeautifier.com

Resource Scan

Scan Details

Site Domain databeautifier.com
Base Domain databeautifier.com
Scan Status Ok
Last Scan2025-12-12T18:34:20+00:00
Next Scan 2026-01-11T18:34:20+00:00

Last Scan

Scanned2025-12-12T18:34:20+00:00
URL https://databeautifier.com/robots.txt
Domain IPs 208.91.199.170
Response IP 208.91.199.170
Found Yes
Hash 9227584b6a7bd24cd25c095473aa4a06c201335c8fd39fbf19be332d06750c1d
SimHash e904691249c1

Groups

*

Rule Path
Disallow /admin/
Disallow /scripts/
Disallow /private/
Disallow /temp/
Disallow /*.php$
Disallow /*.cgi$
Disallow /*?*
Back to top

Other Records

Field Value
sitemap https://databeautifier.com/sitemap.xml
Back to top

Comments

  • Allow all search engines to access the site
  • Disallow access to these folders
  • Disallow access to specific file types
  • Block access to query parameters (optional, if query strings create duplicate content)
  • Sitemap location for better crawling
Back to top