Log In Sign Up

geekdashboard.com
robots.txt

Robots Exclusion Standard data for geekdashboard.com

Resource Scan

Scan Details

Site Domain geekdashboard.com
Base Domain geekdashboard.com
Scan Status Ok
Last Scan2024-11-12T01:23:18+00:00
Next Scan 2024-11-19T01:23:18+00:00

Last Scan

Scanned2024-11-12T01:23:18+00:00
URL https://geekdashboard.com/robots.txt
Redirect https://www.geekdashboard.com/robots.txt
Redirect Domain www.geekdashboard.com
Redirect Base geekdashboard.com
Domain IPs 104.21.73.250, 172.67.151.207, 2606:4700:3031::6815:49fa, 2606:4700:3034::ac43:97cf
Redirect IPs 104.21.73.250, 172.67.151.207, 2606:4700:3031::6815:49fa, 2606:4700:3034::ac43:97cf
Response IP 104.21.73.250
Found Yes
Hash 4832d005bd9444a220f9dfbd56a3b06ee2b62d76cba605a09562b73fcf8e923d
SimHash 25294b80e433

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /recommended/
Disallow /comments/feed/
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /wp-appbox/
Disallow /app/
Disallow /chrome/
Disallow /tools/wng
Disallow /using/
Disallow /go/

mediapartners-google*

Rule Path
Allow /

googlebot-image

Rule Path
Allow /wp-content/uploads/

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

*

Rule Path
Disallow /wp-json/
Disallow /?rest_route=
Disallow /wp-admin/

*

Rule Path
Disallow /?s=
Disallow /search/

*

Rule Path
Disallow /workers/

*

Rule Path
Disallow /wp-content/uploads/complianz/
Disallow /?wp-ajax=

*

Rule Path
Disallow /cdn-cgi/
Disallow /cdn-cgi/image/
Disallow /cdn-cgi/bm/cv/
Disallow /cdn-cgi/challenge-platform/
Disallow /cdn-fpw/sxg/
Back to top

Other Records

Field Value
sitemap https://www.geekdashboard.com/sitemap_index.xml
Back to top

Comments

  • Block some general WP endpoints
  • -----------------
  • Block internal search
  • -----------------
  • Block workers
  • -----------------
  • Block leaky plugins
  • --------------------------------
  • Block leaky Cloudflare endpoints
  • --------------------------------
Back to top