Log In Sign Up

allaboutfaithsite.wordpress.com
robots.txt

Robots Exclusion Standard data for allaboutfaithsite.wordpress.com

Resource Scan

Scan Details

Site Domain allaboutfaithsite.wordpress.com
Base Domain wordpress.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T12:05:13+00:00
Next Scan 2024-12-06T12:05:13+00:00

Last Successful Scan

Scanned2022-10-31T04:54:34+00:00
URL https://allaboutfaithsite.wordpress.com/robots.txt
Response IP 192.0.78.13, 192.0.78.12
Found Yes
Hash cb724b62a5bb580c834d4eb6988bcf839cdc3caf817cb212ae31563e28a467e0
SimHash b117bb4c2ef7

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /wp-signup.php
Disallow /press-this.php
Disallow /remote-login.php
Disallow /activate/
Disallow /cgi-bin/
Disallow /mshots/v1/
Disallow /next/
Disallow /public.api/
Back to top

Other Records

Field Value
sitemap https://allaboutfaithsite.wordpress.com/sitemap.xml
sitemap https://allaboutfaithsite.wordpress.com/news-sitemap.xml
Back to top

Comments

  • If you are regularly crawling WordPress.com sites, please use our firehose to receive real-time push updates instead.
  • Please see https://developer.wordpress.com/docs/firehose/ for more details.
  • This file was generated on Fri, 19 Nov 2021 00:37:00 +0000
Back to top