sellinstate.com
robots.txt

Robots Exclusion Standard data for sellinstate.com

Resource Scan

Scan Details

Site Domain sellinstate.com
Base Domain sellinstate.com
Scan Status Ok
Last Scan2026-03-03T23:42:34+00:00
Next Scan 2026-03-10T23:42:34+00:00

Last Scan

Scanned2026-03-03T23:42:34+00:00
URL https://sellinstate.com/robots.txt
Domain IPs 74.207.241.102
Response IP 74.207.241.102
Found Yes
Hash 07a3974c447a187d2cd3d8f446a30b2b65cff1e1bd8874bd2d6795ec4014c456
SimHash b8cc1e3068fb

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /auth/
Disallow /login
Disallow /register
Disallow /password/
Disallow /email/
Disallow /verification/
Disallow /profile/
Disallow /settings/
Disallow /assets/
Disallow /css/
Disallow /js/
Disallow /vendor/
Disallow /storage/
Disallow /uploads/tmp/
Disallow /mix-manifest.json
Disallow /main.php
Disallow /index.php
Disallow /*?display=*
Disallow /*?sort=*
Disallow /*?order=*
Disallow /*?filter=*
Disallow /*?view=*
Disallow /*?page=*
Disallow /locale/
Disallow /auth/connect/facebook
Disallow /auth/connect/linkedin
Disallow /auth/connect/twitter
Disallow /auth/connect/google
Allow /categories/
Allow /cities/
Allow /listings/
Allow /tags/
Allow /search

Other Records

Field Value
sitemap https://sellinstate.com/us/sitemaps.xml

Comments

  • ==================================================
  • BLOCK ADMIN, AUTH & SENSITIVE AREAS
  • ==================================================
  • ==================================================
  • BLOCK SYSTEM, TECH & INTERNAL FILES
  • ==================================================
  • ==================================================
  • BLOCK DUPLICATE, FILTER & THIN URL PARAMETERS
  • ==================================================
  • ==================================================
  • BLOCK LOCALE DUPLICATES (SEO CANONICAL STRATEGY)
  • ==================================================
  • ==================================================
  • BLOCK SOCIAL AUTH CALLBACK ENDPOINTS
  • ==================================================
  • ==================================================
  • ALLOW CORE SEO CONTENT
  • ==================================================