willmaker.com
robots.txt

Robots Exclusion Standard data for willmaker.com

Resource Scan

Scan Details

Site Domain willmaker.com
Base Domain willmaker.com
Scan Status Ok
Last Scan2025-09-10T21:09:54+00:00
Next Scan 2025-09-24T21:09:54+00:00

Last Scan

Scanned2025-09-10T21:09:54+00:00
URL https://willmaker.com/robots.txt
Redirect https://www.willmaker.com/robots.txt
Redirect Domain www.willmaker.com
Redirect Base willmaker.com
Domain IPs 104.21.81.204, 172.67.164.75, 2606:4700:3033::ac43:a44b, 2606:4700:3034::6815:51cc
Redirect IPs 104.21.81.204, 172.67.164.75, 2606:4700:3033::ac43:a44b, 2606:4700:3034::6815:51cc
Response IP 172.67.164.75
Found Yes
Hash 8c30299847b113fc73861389f3a8fbb5de9943d6aafcec623c4d3255acdf906d
SimHash 4855dc2efe99

Groups

*

Rule Path
Disallow /scripts/
Disallow /profiles/
Disallow /user/
Disallow /users/
Disallow /survey/
Disallow /search2
Disallow /referral/
Disallow /login
Disallow /info/
Disallow /sc/
Disallow /cart
Disallow /companion/
Disallow /consultation/
Disallow /v2/my-site-contact-page
Disallow /admin/
Disallow /comment/reply/
Disallow /contact/
Disallow /inbox
Disallow /inbox/*
Disallow /logout/
Disallow /node/*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=contact%2F
Disallow /?q=logout%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=user
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /manage/
Disallow /downloader*
Disallow /product.cfm*
Disallow /siteIncludes/printerfriendly.cfm*
Disallow /wp-login.php*
Disallow /.well-known/*
Disallow /ckeditor/plugins/nolohelp/images/help.png

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.willmaker.com/sitemaps/willmaker.com/sitemap.xml

Comments

  • Crawl-delay: 10
  • Directories
  • Nolo urls:
  • Ehub Paths
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • NCMS