Log In Sign Up

meeters.org
robots.txt

Robots Exclusion Standard data for meeters.org

Resource Scan

Scan Details

Site Domain meeters.org
Base Domain meeters.org
Scan Status Ok
Last Scan2026-01-12T07:13:38+00:00
Next Scan 2026-01-26T07:13:38+00:00

Last Scan

Scanned2026-01-12T07:13:38+00:00
URL https://meeters.org/robots.txt
Domain IPs 104.21.18.160, 172.67.182.185, 2606:4700:3035::6815:12a0, 2606:4700:3037::ac43:b6b9
Response IP 172.67.182.185
Found Yes
Hash 5379addfc6912fde34c500909b863a324cc8844628499e5f8abfcf6bae9b271a
SimHash 0a09091c02f2

Groups

*

Rule Path
Allow /
Disallow /*.json$
Disallow /*_buildManifest.js$
Disallow /*_middlewareManifest.js$
Disallow /*_ssgManifest.js$
Disallow /*.js$
Back to top

Other Records

Field Value
sitemap https://meeters.org/sitemap.xml
Back to top

Comments

  • Next.JS Crawl Budget Performance Updates
  • Block files ending in .json, _buildManifest.js, _middlewareManifest.js, _ssgManifest.js, and any other JS files
  • The asterisks allows any file name
  • The dollar sign ensures it only matches the end of an URL and not a oddly formatted url (e.g. /locations.json.html)
Back to top