arobasenetdotcom.wpcomstaging.com
robots.txt

Robots Exclusion Standard data for arobasenetdotcom.wpcomstaging.com

Resource Scan

Scan Details

Site Domain arobasenetdotcom.wpcomstaging.com
Base Domain wpcomstaging.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-23T15:43:41+00:00
Next Scan 2024-08-21T15:43:41+00:00

Last Successful Scan

Scanned2023-07-06T10:37:35+00:00
URL https://arobasenetdotcom.wpcomstaging.com/robots.txt
Redirect https://arobasenet.com/robots.txt
Redirect Domain arobasenet.com
Redirect Base arobasenet.com
Domain IPs 192.0.78.20
Redirect IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Response IP 13.250.129.152
Found Yes
Hash 11378074ea20da7fda99b86e18159e294ece477ffab61e07ad904bd7ba88e04d
SimHash eb245d68b394

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/
Disallow /trackback/
Disallow /wp-login.php
Disallow /wp-register.php

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

twitterbot

Rule Path
Disallow *
Allow /images
Allow /archives

Other Records

Field Value
sitemap https://arobasenet.com/sitemap.xml

Comments

  • This virtual robots.txt file was created by the Virtual Robots.txt WordPress plugin: https://www.wordpress.org/plugins/pc-robotstxt/