digitalcitizen.life
robots.txt

Robots Exclusion Standard data for digitalcitizen.life

Resource Scan

Scan Details

Site Domain digitalcitizen.life
Base Domain digitalcitizen.life
Scan Status Ok
Last Scan2024-11-12T02:39:51+00:00
Next Scan 2024-11-19T02:39:51+00:00

Last Scan

Scanned2024-11-12T02:39:51+00:00
URL https://digitalcitizen.life/robots.txt
Domain IPs 104.26.0.105, 104.26.1.105, 172.67.74.202, 2606:4700:20::681a:169, 2606:4700:20::681a:69, 2606:4700:20::ac43:4aca
Response IP 172.67.74.202
Found Yes
Hash a2697a3a70c1dd2523d11d30110b5526e8043f1d127657934d0cfde171dd9812
SimHash 62440a442413

Groups

*

Rule Path Comment
Allow /wp-content/uploads/ -
Allow /wp-content/*.css$ -
Allow /wp-content/*.css? -
Allow /wp-content/*.js$ -
Allow /wp-content/*.js? -
Allow /wp-content/*.gif -
Allow /wp-content/*.jpg -
Allow /wp-content/*.jpeg -
Allow /wp-content/*.png -
Allow /wp-content/*.svg -
Allow /ads/preferences/ -
Allow /gpt/ -
Allow /pagead/show_ads.js -
Allow /pagead/js/adsbygoogle.js -
Allow /pagead/js/*/show_ads_impl.js -
Allow /static/glade.js -
Allow /static/glade/ -
Disallow /wp-content/plugins/ -
Disallow /wp-admin/ -
Disallow /readme.html -
Disallow /refer/ -
Disallow /README.txt -
Disallow /xmlrpc.php -
Disallow /wp-login.php/* -
Disallow /?show=comments -
Disallow /?show=comments respond
Disallow /?s= -
Disallow /feed/?attachment_id=* -
Disallow /*?page= -
Disallow /?page= -
Disallow /?nopaging= -
Disallow /?SD -
Disallow /?SA -
Disallow /?ND -
Disallow /?NA -
Disallow /?MA -
Disallow /?DA -
Disallow /?DD -
Disallow /node -
Disallow /*?wordfence_lh=1&hid* -

Other Records

Field Value
sitemap https://www.digitalcitizen.life/post-sitemap1.xml
sitemap https://www.digitalcitizen.life/post-sitemap2.xml
sitemap https://www.digitalcitizen.life/page-sitemap.xml
sitemap https://www.digitalcitizen.life/category-sitemap.xml
sitemap https://www.digitalcitizen.life/post_tag-sitemap.xml
sitemap https://www.digitalcitizen.life/sponsor-sitemap.xml
sitemap https://www.digitalcitizen.life/author-sitemap.xml
sitemap https://www.digitalcitizen.life/sitemap_index.xml

Comments

  • Directories
  • Files
  • Paths (no clean URLs)
  • Disallow comments specific pages.
  • Disallow drupal pagination
  • Define sitemap and host.

Warnings

  • `host` is not a known field.