appletreeflowers.net
robots.txt

Robots Exclusion Standard data for appletreeflowers.net

Resource Scan

Scan Details

Site Domain appletreeflowers.net
Base Domain appletreeflowers.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-17T15:16:58+00:00
Next Scan 2024-07-16T15:16:58+00:00

Last Successful Scan

Scanned2022-12-02T03:31:38+00:00
URL https://appletreeflowers.net/robots.txt
Redirect https://www.appletreeflowers.net/robots.txt
Redirect Domain www.appletreeflowers.net
Redirect Base appletreeflowers.net
Domain IPs 13.225.78.117, 13.225.78.37, 13.225.78.65, 13.225.78.87
Redirect IPs 18.161.97.62, 18.161.97.75, 18.161.97.80, 18.161.97.82
Response IP 18.161.97.80
Found Yes
Hash ec451a38ed9af2e24d0b314588e7e3e211d2493dc37fc19bdad45613b0c70768
SimHash 7b48dc50a032

Groups

*

Rule Path
Disallow /cache/
Disallow /img/
Disallow /Kristen-Beluzzi
Disallow /Morgan-Daine

Other Records

Field Value
crawl-delay 10

twengabot-2.0

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

aboundexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.appletreeflowers.net/sitemap.xml

Warnings

  • 2 invalid lines.