akismet.com
robots.txt

Robots Exclusion Standard data for akismet.com

Resource Scan

Scan Details

Site Domain akismet.com
Base Domain akismet.com
Scan Status Ok
Last Scan2025-06-17T17:42:32+00:00
Next Scan 2025-07-17T17:42:32+00:00

Last Scan

Scanned2025-06-17T17:42:32+00:00
URL https://akismet.com/robots.txt
Domain IPs 192.0.78.24, 192.0.78.25
Response IP 192.0.78.24
Found Yes
Hash b605505034e555ca3015ec3e37d22c348b6a036f26198c616970c52e04022a69
SimHash b117dc282eb5

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /press-this.php
Disallow /remote-login.php
Disallow /activate/
Disallow /cgi-bin/
Disallow /mshots/v1/
Disallow /next/
Disallow /public.api/

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Allow /features/
Allow /enterprise/
Allow /developers/
Allow /pricing/
Allow /resources/
Allow /documentation/
Allow /getting-started/
Allow /general/
Allow /features-2/
Allow /billing/
Allow /account/
Allow /blog/
Allow /contact-us/
Allow /plugins-libraries/
Allow /terms-of-service/
Allow /privacy-policy/
Disallow /?aff=11788%2F
Disallow /?aff=15024%2F
Disallow /?aff=3431%2F
Disallow /?aff=4328%2F
Disallow /?aff=52239%2F
Disallow /?aff=57206%2F
Disallow /?aff=7295%2F
Disallow /?aff=975%2F
Disallow /?country=1021%2F
Disallow /?industry=agency%2F
Disallow /?hsFormKey=00c2cf09d3e2337ec3b798e6331f08c2%2F
Disallow /?return=true%2F
Disallow /?return=trueDescription%2F
Disallow /?source=post_page%2F
Disallow /?sw=1%2F
Disallow /?v=2%2F
Disallow /lang%3Dcs/
Disallow /?region=australia-and-new-zealand%2F
Disallow /category/activation/
Disallow /category/announcements/
Disallow /category/blogroll/
Disallow /category/coldfusion/
Disallow /category/commercial/
Disallow /category/competition/
Disallow /category/development/
Disallow /category/downtime/
Disallow /category/drupal/
Disallow /category/features/
Disallow /category/general/
Disallow /implementations/
Disallow /category/jetpack/
Disallow /category/milestone/
Disallow /category/misc/
Disallow /category/monthly-roundup/
Disallow /category/news/
Disallow /category/partners/
Disallow /category/permissions/
Disallow /category/product/
Disallow /category/releases/
Disallow /category/spam/
Disallow /category/testimonials/
Disallow /category/tips/
Disallow /category/uncategorized/
Disallow /category/upgrades/
Disallow /category/wordpress/
Disallow /tag/60-billion/
Disallow /tag/affiliate/
Disallow /tag/akelos/
Disallow /tag/akismet/
Disallow /tag/awesome-post/
Disallow /tag/blog-posts/
Disallow /tag/college/
Disallow /tag/comments/
Disallow /tag/developer-tips/
Disallow /tag/development/
Disallow /tag/disqus/
Disallow /tag/education/
Disallow /tag/forums/
Disallow /tag/gdpr/
Disallow /tag/outage/
Disallow /tag/partial-outage/
Disallow /tag/partner-program/
Disallow /tag/php/
Disallow /tag/plugin/
Disallow /tag/plugins/
Disallow /tag/pre-release/
Disallow /tag/privacy/
Disallow /tag/referral/
Disallow /tag/releases/
Disallow /tag/school/
Disallow /tag/security/
Disallow /tag/seo/
Disallow /tag/spam/
Disallow /tag/spammers-say-the-darndest-things/
Disallow /tag/stats/
Disallow /tag/testing/
Disallow /tag/trackbacks/
Disallow /tag/tweets/
Disallow /tag/university/
Disallow /tag/wordpress/
Disallow /tag/year-in-review/

Other Records

Field Value
sitemap https://akismet.com/sitemap.xml
sitemap https://akismet.com/news-sitemap.xml
sitemap https://akismet.com/sitemap.xml

Comments

  • If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
  • Please see https://developer.wordpress.com/docs/firehose/ for more details.
  • This file was generated on Fri, 31 Jan 2025 01:06:17 +0000