Log In Sign Up

ofset.org
robots.txt

Robots Exclusion Standard data for ofset.org

Resource Scan

Scan Details

Site Domain ofset.org
Base Domain ofset.org
Scan Status Ok
Last Scan2025-10-19T17:46:55+00:00
Next Scan 2025-11-18T17:46:55+00:00

Last Scan

Scanned2025-10-19T17:46:55+00:00
URL https://ofset.org/robots.txt
Domain IPs 104.21.46.70, 172.67.136.16, 2606:4700:3033::ac43:8810, 2606:4700:3037::6815:2e46
Response IP 172.67.136.16
Found Yes
Hash df6060c9f1dc602aadfba07b2145e1e75c7de68084310e516b749b2afe5b6f19
SimHash 3aed5b3ba49a

Groups

*

Rule Path
Allow /
Allow /?id_ID=*
Allow /*?id_ID=*
Allow /?id_ID=*&amp=1
Allow /*?id_ID=*&amp=1
Disallow /admin/
Disallow /includes/
Disallow /assets/
Disallow /vendor/
Disallow /node_modules/
Disallow /*.php$
Disallow /config.php
Disallow /install*
Disallow /test*
Disallow /fix*
Disallow /debug*
Disallow /*.sql
Disallow /*.log
Disallow /.htaccess
Disallow /.env
Disallow /*.backup
Disallow /*.tmp
Disallow /*.bak
Disallow /*~
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Allow /sitemap.xml
Allow /sitemap*.xml
Allow /robots.txt
Allow /favicon.ico
Allow /*.css
Allow /*.js
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.webp
Allow /*.svg
Back to top

Other Records

Field Value
sitemap https://ofset.org/sitemap.xml
Back to top

Comments

  • Robots.txt for SEO-optimized sitemap generator
  • Generated automatically for: ofset.org
  • URL Method: Page Method (?id_ID=keyword)
  • Generated: 2025-09-23 14:28:30
  • Allow crawling of keyword pages (query parameters)
  • Allow AMP pages with query parameters
  • Block system and admin files (if present)
  • Block backup and temporary files
  • Block common CMS files
  • Allow important SEO files
  • Sitemap location
  • Additional sitemaps (if using sitemap index)
  • Sitemap: https://ofset.org/sitemap.xml
Back to top