Log In Sign Up

jeffmcneill.com
robots.txt

Robots Exclusion Standard data for jeffmcneill.com

Resource Scan

Scan Details

Site Domain jeffmcneill.com
Base Domain jeffmcneill.com
Scan Status Ok
Last Scan2026-02-06T03:47:30+00:00
Next Scan 2026-02-07T03:47:30+00:00

Last Scan

Scanned2026-02-06T03:47:30+00:00
URL https://jeffmcneill.com/robots.txt
Domain IPs 2a01:4f8:c013:e060::, 91.99.90.144
Response IP 91.99.90.144
Found Yes
Hash 87a87a733c0ebe5a1c613705a5ba6419425d89208424e9dbea9c49c0048c72c9
SimHash 7a3dd76ae339

Groups

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Allow /wp-includes/css/
Disallow /trackback/
Disallow /feed/
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /order-cancelled*
Disallow /order-completed*
Disallow /estore-action*
Disallow /account*
Disallow /index-az*
Disallow /checkout*
Disallow /contact-submitted*
Back to top

Other Records

Field Value
sitemap https://jeffmcneill.com/sitemap.xml
Back to top

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/
  • robots.txt for https://jeffmcneill.com
  • Disallow the Internet Archive
  • For all other agents
  • Include the full sitemap url for discovery
  • Note, this may do such on its own as it can sometimes detect one
  • So check the rendered file before addit it manually here
  • Yandex complains without this
  • Disallow specific files or directories
  • Disallow: /filenames*
  • Disallow: /directory-and-contents/*
  • Disallow and allow some wordpress stuff
  • End of wordpress stuff
  • Some internal blocks
  • End of internal blocks
  • Note: any blocked pages should also have a meta tag
  • Put this in the Raw Data section of HeadSpace
Back to top

Warnings

  • `host` is not a known field.
Back to top