soft4led.com
robots.txt

Robots Exclusion Standard data for soft4led.com

Resource Scan

Scan Details

Site Domain soft4led.com
Base Domain soft4led.com
Scan Status Ok
Last Scan2024-10-03T09:43:59+00:00
Next Scan 2024-10-10T09:43:59+00:00

Last Scan

Scanned2024-10-03T09:43:59+00:00
URL https://soft4led.com/robots.txt
Redirect https://teckwiki.com/robots.txt
Redirect Domain teckwiki.com
Redirect Base teckwiki.com
Domain IPs 104.21.78.25, 172.67.215.27, 2606:4700:3036::6815:4e19, 2606:4700:3037::ac43:d71b
Redirect IPs 162.213.251.107
Response IP 162.213.251.107
Found Yes
Hash fc87833de71b6f9ce76243704ab9d23163d2b5a72db21ba6df11ff3a7800476d
SimHash 6f4b5c44e692

Groups

*

Rule Path
Disallow /admin/
Disallow /private/
Disallow /secret/
Disallow /cgi-bin/
Disallow /tmp/
Disallow /temp/
Disallow /cache/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-login.php
Disallow /login/
Disallow /register/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.soft4led.com/sitemap_index.xml

Comments

  • Crawling budget
  • Sitemap location