Log In Sign Up

my.dek-d.com
robots.txt

Robots Exclusion Standard data for my.dek-d.com

Resource Scan

Scan Details

Site Domain my.dek-d.com
Base Domain dek-d.com
Scan Status Ok
Last Scan2025-05-02T10:35:57+00:00
Next Scan 2025-06-01T10:35:57+00:00

Last Scan

Scanned2025-05-02T10:35:57+00:00
URL https://my.dek-d.com/robots.txt
Redirect https://my.dek-d.com/robots.txt/
Domain IPs 49.0.199.229, 94.74.116.230
Response IP 94.74.116.230
Found Yes
Hash b66f06ac335eca82ac28327e203e8c9365df50679d8ab0fefd065b470aa9e99a
SimHash 6505f85540b5

Groups

*

No rules defined. All paths allowed.

Back to top

Other Records

Field Value
sitemap https://www.dek-d.com/sitemap/writer/
sitemap https://writer.dek-d.com/sitemap.xml
sitemap https://my.dek-d.com/sitemap-visualnovel.xml
Back to top

Comments

  • Disallow all crawlers access to certain pages.
  • Disallow: *
  • Allow: */writer*
  • Allow: */story/viewlongc.php*
  • Allow: */visualnovel/?vn_id=*
  • Allow: */funnyquiz/?id=*
  • Allow: */supertest/?id=*
  • Allow: */quizmaze/?id=*
  • Allow: */visualnovel/?vn_id=*
  • Allow: */*/view.php*
  • Allow: */blog/?blog_id=*
  • Allow: */diary/?blog_id=*
  • Allow: */myboard/view.php?id=*
  • To reduce speed time from crawling
  • User-agent: bingbot
  • Crawl-delay: 1
  • Sitemap files
  • Sitemap: https://www.dek-d.com/sitemap-member-index.xml
Back to top