Log In Sign Up

dailycartoonist.com
robots.txt

Robots Exclusion Standard data for dailycartoonist.com

Resource Scan

Scan Details

Site Domain dailycartoonist.com
Base Domain dailycartoonist.com
Scan Status Ok
Last Scan2024-11-13T15:36:30+00:00
Next Scan 2024-11-20T15:36:30+00:00

Last Scan

Scanned2024-11-13T15:36:30+00:00
URL https://dailycartoonist.com/robots.txt
Redirect https://www.dailycartoonist.com/robots.txt
Redirect Domain www.dailycartoonist.com
Redirect Base dailycartoonist.com
Domain IPs 104.168.159.200
Redirect IPs 104.168.159.200
Response IP 104.168.159.200
Found Yes
Hash 78689f6f1560e3e62fc69064d3049a7f5f153c1f9120f444dc5cd148220bb8a0
SimHash 90220c0b1d53

Groups

_

Rule Path
Disallow /wp-admin/
Disallow /_/feed
Disallow /%5C*/feed/
Disallow /wp-admin/admin-ajax.php
Allow /index.php/feed
Allow /index.php/category
Allow /index.php/category/%5C*
Allow /index.php/tag
Allow /index.php/tag/%5C*
Allow /comments/feed
Allow /index.php/comments/feed
Back to top

Other Records

Field Value
sitemap https://www.dailycartoonist.com/sitemap.xml
sitemap https://www.dailycartoonist.com/sitemap.html
Back to top

Comments

  • Allow the primary feed
  • Allow feeds for categories
  • Allow feeds for tags
  • Allow feeds for post comments
Back to top