diyideacenter.com
robots.txt

Robots Exclusion Standard data for diyideacenter.com

Resource Scan

Scan Details

Site Domain diyideacenter.com
Base Domain diyideacenter.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-13T21:23:20+00:00
Next Scan 2024-05-20T21:23:20+00:00

Last Successful Scan

Scanned2023-04-19T23:43:13+00:00
URL https://diyideacenter.com/robots.txt
Redirect https://www.diyideacenter.com/robots.txt
Redirect Domain www.diyideacenter.com
Redirect Base diyideacenter.com
Domain IPs 52.84.45.11, 52.84.45.15, 52.84.45.18, 52.84.45.57
Redirect IPs 18.172.213.56, 18.172.213.79, 18.172.213.88, 18.172.213.90
Response IP 13.33.21.63
Found Yes
Hash be2c10084628895731ef27aaeab979ac15f6d811903f456e5412cd3b04103506
SimHash 61349c45ca95

Groups

*

Rule Path
Disallow /admin/
Disallow /site_admin/
Disallow /primeads/
Disallow /preview_article/

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.diyideacenter.com/www.diyideacenter.com.xml