aspirityenergy.com
robots.txt

Robots Exclusion Standard data for aspirityenergy.com

Resource Scan

Scan Details

Site Domain aspirityenergy.com
Base Domain aspirityenergy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-07T16:53:55+00:00
Next Scan 2024-10-05T16:53:55+00:00

Last Successful Scan

Scanned2022-02-02T21:29:02+00:00
URL https://aspirityenergy.com/robots.txt
Redirect https://www.aspirityenergy.com/robots.txt
Redirect Domain www.aspirityenergy.com
Redirect Base aspirityenergy.com
Response IP 69.167.149.228
Found Yes
Hash d8d7a63ca7aef0c0d90544d35b6acb3820b3e331352d73a8b8a2a7c6a43d56fa
SimHash 6004e9d14615

Groups

mediapartners-google

Rule Path
Disallow

architextspider
baiduspider
googlebot
googlebot-image
mediapartners-google
msnbot
msnbot-media
yahoo-blogs
yahoo-mmcrawler
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aspirityenergy.com/sitemap-category.xml

Comments

  • allow only important bots