goingdecor.com
robots.txt

Robots Exclusion Standard data for goingdecor.com

Resource Scan

Scan Details

Site Domain goingdecor.com
Base Domain goingdecor.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-10T06:36:57+00:00
Next Scan 2024-12-09T06:36:57+00:00

Last Successful Scan

Scanned2023-10-24T03:37:18+00:00
URL https://www.goingdecor.com/robots.txt
Domain IPs 72.32.177.16
Response IP 72.32.177.16
Found Yes
Hash 9b61bb98e684c317a5179b40b31ecc849aad2b7f8d9e58fee52eb82ee6f9eb4d
SimHash 6256f450f802

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1.0

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10.0

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5.0

redcarpet
addthis.com
ahrefsbot
baiduspider
becomebot
blexbot
camontspider
converacrawler
dealozbot
discobot
dotbot
exabot
fatbot
mj12bot
naverbot
ocelli
psbot
scoutjet
semanticbot
semanticdiscovery
shopwiki
sogou spider
sosospider
speedy
turnitinbot
twengabot
twiceler
ubicrawler
voyager
yandex
yanga

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.goingdecor.com/FjQaMU9v/SiteMapIndex.xml

Comments

  • Sitemaps

Warnings

  • 1 invalid line.