Log In Sign Up

ewdn.com
robots.txt

Robots Exclusion Standard data for ewdn.com

Resource Scan

Scan Details

Site Domain ewdn.com
Base Domain ewdn.com
Scan Status Ok
Last Scan2025-10-09T07:57:23+00:00
Next Scan 2025-11-08T07:57:23+00:00

Last Scan

Scanned2025-10-09T07:57:23+00:00
URL https://ewdn.com/robots.txt
Domain IPs 104.21.90.168, 172.67.158.53, 2606:4700:3031::ac43:9e35, 2606:4700:3032::6815:5aa8
Response IP 104.21.90.168
Found Yes
Hash 3a11421f2708fd48145011862335fa5c930afb527860a89ece12d50113e0618b
SimHash 5a199512c7e4

Groups

yisouspider

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-comments
Disallow */trackback
Disallow */comments

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow */trackback
Disallow */comments

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-trackback
Disallow /wp-comments
Disallow */trackback
Disallow */comments

Other Records

Field Value
crawl-delay 300
Back to top

Other Records

Field Value
sitemap http://www.ewdn.com/Sitemap.xml
sitemap http://www.ewdn.com/Sitemap.xml
sitemap http://www.ewdn.com/Sitemap.xml
Back to top

Comments

  • This file can be used to affect how search engines and other web site crawlers see your site.
  • For more information, please see http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1
  • WebMatrix 2.0
  • This file can be used to affect how search engines and other web site crawlers see your site.
  • For more information, please see http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1
  • WebMatrix 2.0
  • This file can be used to affect how search engines and other web site crawlers see your site.
  • For more information, please see http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1
  • WebMatrix 2.0
Back to top