thejeffreylord.com
robots.txt

Robots Exclusion Standard data for thejeffreylord.com

Resource Scan

Scan Details

Site Domain thejeffreylord.com
Base Domain thejeffreylord.com
Scan Status Ok
Last Scan2024-05-27T17:57:56+00:00
Next Scan 2024-06-03T17:57:56+00:00

Last Scan

Scanned2024-05-27T17:57:56+00:00
URL https://thejeffreylord.com/robots.txt
Domain IPs 104.16.150.108, 104.16.151.108, 2606:4700::6810:966c, 2606:4700::6810:976c
Response IP 104.16.150.108
Found Yes
Hash 69a227eeed0484041cb97554f858475e3ee5a80c2f178e276c7a6294ec8c68f0
SimHash 010cccd047f5

Groups

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /*?v
Disallow /calendar/action*
Disallow /events/action*

Comments

  • Default Flywheel robots file
  • Crawl-delay: 3