Log In Sign Up

fyilight.com
robots.txt

Robots Exclusion Standard data for fyilight.com

Resource Scan

Scan Details

Site Domain fyilight.com
Base Domain fyilight.com
Scan Status Ok
Last Scan2026-02-12T02:14:37+00:00
Next Scan 2026-03-14T02:14:37+00:00

Last Scan

Scanned2026-02-12T02:14:37+00:00
URL https://fyilight.com/robots.txt
Redirect https://www.fyilight.com/robots.txt
Redirect Domain www.fyilight.com
Redirect Base fyilight.com
Domain IPs 104.21.89.43, 172.67.156.89, 2606:4700:3033::ac43:9c59, 2606:4700:3034::6815:592b
Redirect IPs 104.21.89.43, 172.67.156.89, 2606:4700:3033::ac43:9c59, 2606:4700:3034::6815:592b
Response IP 172.67.156.89
Found Yes
Hash dc0e58aba65ce51dbce964872a202573b805d81c4ff9bfe231ccd04b292dd972
SimHash e65e4cd8aea2

Groups

*

Rule Path
Disallow /admin
Disallow /src
Disallow /cdn-cgi/rum

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

backlinksextendedbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

clearscopebot

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

expanse

Rule Path
Disallow /

crawler_eb_germany

Rule Path
Disallow /

l9explore

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600
Back to top

Other Records

Field Value
sitemap https://www.fyilight.com/sitemap.xml
sitemap https://www.fyilight.com/sitemap-nav.xml
sitemap https://www.fyilight.com/sitemap-product.xml
sitemap https://www.fyilight.com/sitemap-article.xml
sitemap https://www.fyilight.com/sitemap-video.xml
sitemap https://www.fyilight.com/sitemap-case.xml
sitemap https://www.fyilight.com/sitemap-product-tag.xml
sitemap https://www.fyilight.com/sitemap-a-article.xml
sitemap https://www.fyilight.com/sitemap-a-products.xml
sitemap https://www.fyilight.com/sitemap-a-guides.xml
sitemap https://www.fyilight.com/sitemap-a-video.xml
sitemap https://www.fyilight.com/sitemap-a-img.xml
sitemap https://www.fyilight.com/sitemap-image-1.xml
sitemap https://www.fyilight.com/sitemap-image-2.xml
Back to top