goinglighting.com
robots.txt

Robots Exclusion Standard data for goinglighting.com

Resource Scan

Scan Details

Site Domain goinglighting.com
Base Domain goinglighting.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-09T13:21:52+00:00
Next Scan 2024-12-08T13:21:52+00:00

Last Successful Scan

Scanned2023-10-23T01:01:13+00:00
URL https://goinglighting.com/robots.txt
Redirect https://www.goinglighting.com:443/robots.txt
Redirect Domain www.goinglighting.com
Redirect Base goinglighting.com
Domain IPs 72.32.177.16
Redirect IPs 72.32.177.16
Response IP 72.32.177.16
Found Yes
Hash a15a78aeb642f7564a1aeace93f75e56a1c712ea56bcf8c0cfd99da946732046
SimHash 6256b4d0d802

Groups

*

Rule Path
Allow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10.0

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

redcarpet
addthis.com
ahrefsbot
baiduspider
becomebot
blexbot
camontspider
converacrawler
dealozbot
discobot
dotbot
exabot
fatbot
mj12bot
naverbot
ocelli
psbot
scoutjet
semanticbot
semanticdiscovery
shopwiki
sogou spider
sosospider
speedy
turnitinbot
twengabot
twiceler
ubicrawler
voyager
yandex
yanga

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.goinglighting.com/6pAdBxfB/SiteMapIndex.xml

Comments

  • Sitemaps

Warnings

  • 1 invalid line.