Log In Sign Up

professionalpestcontrolservice.com
robots.txt

Robots Exclusion Standard data for professionalpestcontrolservice.com

Resource Scan

Scan Details

Site Domain professionalpestcontrolservice.com
Base Domain professionalpestcontrolservice.com
Scan Status Ok
Last Scan2025-12-10T19:32:48+00:00
Next Scan 2026-01-09T19:32:48+00:00

Last Scan

Scanned2025-12-10T19:32:48+00:00
URL https://professionalpestcontrolservice.com/robots.txt
Domain IPs 191.101.228.96, 2a02:4780:84:f20:4b93:b487:5ca0:38bd, 2a02:4780:84:f460:923b:5e8:da12:ac8a, 93.127.187.95
Response IP 77.37.48.244
Found Yes
Hash 5d9bd4be1a81bb4852ac4c5e58b23190c13e54bba5534e5dd7f63d03201678b3
SimHash 250c515ac60f

Groups

*

Rule Path
Allow /
Disallow /Admin/
Disallow /login/
Disallow /checkout/
Disallow /cart/
Disallow /order-history/
Disallow /*.sql$
Disallow /*.env$
Disallow /*.log$
Disallow /search/
Back to top

Other Records

Field Value
sitemap https://professionalpestcontrolservice.com/sitemap.xml
Back to top

Comments

  • Allow all web crawlers to access all content
  • Block web crawlers from accessing private or sensitive areas
  • Block crawlers from specific file types (e.g., database or sensitive scripts)
  • Disallow search results pages (often not useful for indexing)
  • Specify the location of the website's sitemap
Back to top