Log In Sign Up

engine-light-help.com
robots.txt

Robots Exclusion Standard data for engine-light-help.com

Resource Scan

Scan Details

Site Domain engine-light-help.com
Base Domain engine-light-help.com
Scan Status Ok
Last Scan2025-09-24T06:47:16+00:00
Next Scan 2025-10-01T06:47:16+00:00

Last Scan

Scanned2025-09-24T06:47:16+00:00
URL https://engine-light-help.com/robots.txt
Redirect https://www.engine-light-help.com/robots.txt
Redirect Domain www.engine-light-help.com
Redirect Base engine-light-help.com
Domain IPs 104.26.0.12, 104.26.1.12, 172.67.69.122, 2606:4700:20::681a:10c, 2606:4700:20::681a:c, 2606:4700:20::ac43:457a
Redirect IPs 104.26.0.12, 104.26.1.12, 172.67.69.122, 2606:4700:20::681a:10c, 2606:4700:20::681a:c, 2606:4700:20::ac43:457a
Response IP 104.26.1.12
Found Yes
Hash 184b434d4a4c19562f9e825064c466c51866efb23bdf626a65435eae1c17286b
SimHash 0c5eda9074c6

Groups

*

Rule Path
Disallow /

bingbot
bingpreview
slurp
applebot
googlebot
googlebot-image
mediapartners-google
archive.org_bot
baiduspider
duckduckbot

Rule Path
Disallow

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2.0
Back to top

Comments

  • E-L-H last updated 2020-01-31
  • Block everyone first
  • Except allowed bots
  • 2020-01-31 slow down crawlers that don't send much traffic
Back to top