thegreeksenergy.com
robots.txt

Robots Exclusion Standard data for thegreeksenergy.com

Resource Scan

Scan Details

Site Domain thegreeksenergy.com
Base Domain thegreeksenergy.com
Scan Status Ok
Last Scan2024-04-24T09:25:31+00:00
Next Scan 2024-05-24T09:25:31+00:00

Last Scan

Scanned2024-04-24T09:25:31+00:00
URL https://thegreeksenergy.com/robots.txt
Redirect https://www.thegreeksenergy.com/robots.txt
Redirect Domain www.thegreeksenergy.com
Redirect Base thegreeksenergy.com
Domain IPs 104.21.87.52, 172.67.141.133, 2606:4700:3034::ac43:8d85, 2606:4700:3035::6815:5734
Redirect IPs 104.21.87.52, 172.67.141.133, 2606:4700:3034::ac43:8d85, 2606:4700:3035::6815:5734
Response IP 172.67.141.133
Found Yes
Hash 90ea1c50ae32261622919a1bfca34c86b021c21531ccf12b85d26492a6222977
SimHash 22113053c912

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

lipperhey spider

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ncbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

pagesinventory

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.thegreeksenergy.com/sitemap.xml
sitemap https://www.thegreeksenergy.com/sitemap.rss