Log In Sign Up

fastplumbers.net.au
robots.txt

Robots Exclusion Standard data for fastplumbers.net.au

Resource Scan

Scan Details

Site Domain fastplumbers.net.au
Base Domain fastplumbers.net.au
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-02-05T13:58:42+00:00
Next Scan 2026-05-06T13:58:42+00:00

Last Successful Scan

Scanned2023-06-26T21:56:48+00:00
URL https://fastplumbers.net.au/robots.txt
Domain IPs 103.27.34.50
Response IP 103.27.34.50
Found Yes
Hash f0565872321af58f6623861467011a09dd986269b77e2d4708a83328633e1086
SimHash b44058b1059b

Groups

googlebot

Rule Path
Allow *.js
Allow *.css
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /wp-admin
Disallow /*/feed/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback/
Disallow /wp-register.php
Back to top

Other Records

Field Value
sitemap https://fastplumbers.net.au/sitemap_index.xml
sitemap https://fastplumbers.net.au/page-sitemap.xml
sitemap https://fastplumbers.net.au/post-sitemap.xml
Back to top

Comments

  • Allow files critical for rendering
  • Allow AJAX - Do Not Remove
  • Prevent crawl-budget waste on search pages
  • Prevent private admin areas from being crawled
  • Prevent duplicate /feed/ pages from being crawled
  • Prevent login page crawls etc
  • Prevent register page crawls etc
  • Prevent Trackback Neg SEO
  • Allow AJAX - Do Not Remove
Back to top