heritagefl.com
robots.txt

Robots Exclusion Standard data for heritagefl.com

Resource Scan

Scan Details

Site Domain heritagefl.com
Base Domain heritagefl.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-22T01:01:23+00:00
Next Scan 2025-01-20T01:01:23+00:00

Last Successful Scan

Scanned2024-06-25T00:59:25+00:00
URL https://heritagefl.com/robots.txt
Redirect https://www.heritagefl.com/robots.txt
Redirect Domain www.heritagefl.com
Redirect Base heritagefl.com
Domain IPs 35.165.62.155
Redirect IPs 35.165.62.155
Response IP 35.165.62.155
Found Yes
Hash 407fc7c625e412bca46a5152efb1c1993a5d0f9f993d17570f1ff0921e415fe3
SimHash 222f5de106d1

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gnowitnewsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

ezoicbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

cloudflare-alwaysonline

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

msnbot-udiscovery

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /cgi-bin/
Disallow /app/pages_staff/
Disallow /addyourcomment/
Disallow /loadstory/
Disallow /login?r=*
Disallow /samples/
Disallow /system/
Disallow /trash/
Disallow /upload/
Disallow /.TEMP/
Disallow /~.0.lionslight.com/
Disallow /~.1.lionslight.com/
Disallow /~.2.lionslight.com/
Disallow /~.3.lionslight.com/
Disallow /~.4.lionslight.com/
Disallow /~.5.lionslight.com/
Disallow /~.6.lionslight.com/
Disallow /~.7.lionslight.com/
Disallow /~.8.lionslight.com/
Disallow /~.9.lionslight.com/
Disallow /~.10.lionslight.com/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap HTTPS://www.heritagefl.com/sitemap_index.xml