anthonydoty.com
robots.txt

Robots Exclusion Standard data for anthonydoty.com

Resource Scan

Scan Details

Site Domain anthonydoty.com
Base Domain anthonydoty.com
Scan Status Ok
Last Scan2024-06-16T03:19:07+00:00
Next Scan 2024-06-23T03:19:07+00:00

Last Scan

Scanned2024-06-16T03:19:07+00:00
URL https://anthonydoty.com/robots.txt
Domain IPs 66.235.200.147
Response IP 66.235.200.147
Found Yes
Hash 9ecb38997afa56135bdc9b9aaeabcee7c529f826b9303d89e47e1fcdf15909a5
SimHash 67b45d25e6ea

Groups

*

Rule Path
Disallow /trackback/
Disallow /xmlrpc.php
Disallow /wp-*.php
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /search
Disallow /*?sessionid=
Disallow /*?replytocom=
Disallow /*?utm_source=
Disallow /*?utm_medium=
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /wp-content/plugins/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://anthonydoty.com/sitemap.xml
sitemap https://anthonydoty.com/sitemap-home.xml
sitemap https://anthonydoty.com/sitemap-posts.xml
sitemap https://anthonydoty.com/sitemap-pages.xml
sitemap https://anthonydoty.com/sitemap-categories.xml
sitemap https://anthonydoty.com/sitemap-tags.xml
sitemap https://anthonydoty.com/sitemap-archives.xml
sitemap https://anthonydoty.com/sitemap-custom-taxonomies.xml
sitemap https://anthonydoty.com/sitemap-custom-posts.xml
sitemap https://www.anthonydoty.com/sitemap.xml
sitemap https://anthonydoty.com/sitemap.xml
sitemap http://www.anthonydoty.com/sitemap.xml
sitemap http://anthonydoty.com/sitemap.xml

Comments

  • Squirrly SEO Robots
  • Crawl delay to prevent server overload
  • Sitemaps