Log In Sign Up

debbiegrattan.com
robots.txt

Robots Exclusion Standard data for debbiegrattan.com

Resource Scan

Scan Details

Site Domain debbiegrattan.com
Base Domain debbiegrattan.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-07-02T10:11:23+00:00
Next Scan 2025-08-01T10:11:23+00:00

Last Successful Scan

Scanned2025-05-11T09:56:20+00:00
URL https://debbiegrattan.com/robots.txt
Domain IPs 67.202.70.183
Response IP 67.202.70.183
Found Yes
Hash e805707a155b9f7a627a3bbe116980432d8ddfe0ec322eea559893e09f3628d5
SimHash 354019b12592

Groups

googlebot

Rule Path
Allow *.js
Allow *.css
Allow /wp-admin/admin-ajax.php
Disallow /?s=
Disallow /search/
Disallow /wp-admin
Disallow /*/feed/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/
Disallow /readme.html
Disallow /refer/

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin
Disallow /wp-login.php
Disallow /trackback/
Disallow /wp-register.php
Disallow /readme.html
Disallow /refer/
Back to top

Other Records

Field Value
sitemap https://www.debbiegrattan.com/sitemap_index.xml
sitemap https://www.debbiegrattan.com/post-sitemap.xml
sitemap https://www.debbiegrattan.com/page-sitemap.xml
sitemap https://www.debbiegrattan.com/category-sitemap.xml
sitemap https://www.debbiegrattan.com/post_tag-sitemap.xml
sitemap https://www.debbiegrattan.com/wpm-testimonial-category-sitemap.xml
sitemap https://www.debbiegrattan.com/author-sitemap.xml
Back to top

Comments

  • Allow files critical for rendering
  • Allow AJAX - Do Not Remove
  • Prevent crawl-budget waste on search pages
  • Prevent private admin areas from being crawled
  • Prevent duplicate /feed/ pages from being crawled
  • Prevent login page crawls etc
  • Prevent register page crawls etc
  • Prevent Trackback Neg SEO
  • Allow AJAX - Do Not Remove
  • Add all sitemaps
Back to top