plumberyp.com
robots.txt

Robots Exclusion Standard data for plumberyp.com

Resource Scan

Scan Details

Site Domain plumberyp.com
Base Domain plumberyp.com
Scan Status Ok
Last Scan2026-02-10T08:12:15+00:00
Next Scan 2026-03-12T08:12:15+00:00

Last Scan

Scanned2026-02-10T08:12:15+00:00
URL https://plumberyp.com/robots.txt
Domain IPs 104.21.6.101, 172.67.134.181, 2606:4700:3031::6815:665, 2606:4700:3035::ac43:86b5
Response IP 172.67.134.181
Found Yes
Hash 6c4b457bfb61ab31f9058373f8f02979f3f67a4e7ebee22d5e1cad846be9b3f6
SimHash cf045c12a3b0

Groups

*

Rule Path
Allow /
Disallow /*.json$
Disallow /*.php$
Allow /about-us.php
Allow /contact-us.php
Allow /services/*.php

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://plumberyp.com/sitemap.xml

Comments

  • Disallow specific file types
  • Allow specific pages
  • Sitemap
  • Crawl rate