davidgessner.com
robots.txt

Robots Exclusion Standard data for davidgessner.com

Resource Scan

Scan Details

Site Domain davidgessner.com
Base Domain davidgessner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-15T20:00:03+00:00
Next Scan 2025-07-14T20:00:03+00:00

Last Successful Scan

Scanned2024-11-24T11:32:31+00:00
URL https://davidgessner.com/robots.txt
Redirect https://www.davidgessner.com/robots.txt
Redirect Domain www.davidgessner.com
Redirect Base davidgessner.com
Domain IPs 104.21.36.177, 172.67.198.63, 2606:4700:3031::ac43:c63f, 2606:4700:3037::6815:24b1
Redirect IPs 104.21.36.177, 172.67.198.63, 2606:4700:3031::ac43:c63f, 2606:4700:3037::6815:24b1
Response IP 172.67.198.63
Found Yes
Hash 1293f76b904df75b9ad6c53e0d1bcecea460d9083611d13e8e5867efd3afd231
SimHash 01801f641add

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /contacts
Disallow /?s=
Disallow /privacy-policy
Disallow /search
Disallow /author/
Disallow /terms-and-conditions
Disallow */feed
Disallow */rss
Disallow */embed
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*/*.js
Allow /*/*.css
Allow /wp-*.png
Allow /wp-*.jpg
Allow /wp-*.jpeg
Allow /wp-*.gif
Allow /wp-*.svg
Allow /wp-*.pdf

Other Records

Field Value
sitemap https://www.davidgessner.com/wp-sitemap.xml