Log In Sign Up

dreamota.com
robots.txt

Robots Exclusion Standard data for dreamota.com

Resource Scan

Scan Details

Site Domain dreamota.com
Base Domain dreamota.com
Scan Status Ok
Last Scan2024-10-30T17:19:14+00:00
Next Scan 2024-11-06T17:19:14+00:00

Last Scan

Scanned2024-10-30T17:19:14+00:00
URL https://dreamota.com/robots.txt
Redirect https://www.dreamota.com/robots.txt
Redirect Domain www.dreamota.com
Redirect Base dreamota.com
Domain IPs 45.79.140.108
Redirect IPs 45.79.140.108
Response IP 45.79.140.108
Found Yes
Hash 7e550031f65adc9bbc6d01b1ec929b2532ec9cbb30f21688c154b71975261b0e
SimHash 0a544c12faeb

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login/
Disallow /*.inc$
Disallow /trackback/
Disallow /feed/
Disallow /go/
Disallow /go.pl

ia_archiver

Rule Path
Disallow /

duggmirror
ahrefsbot
mj12bot
rogerbot
exabot
dotbot
gigabot
blekkobot

No rules defined. All paths allowed.

Back to top

Comments

  • Disallow:/dreamdictionary
  • Disallow: /privacy
  • Disallow: /contact
  • Disallow: /wp-content/
  • Disallow: /*.js$
  • Disallow: /*.css$
  • User-agent: Googlebot-Image
  • Disallow: /wp-includes/
  • User-agent: Mediapartners-Google*
  • Disallow:
  • User-agent:
  • Disallow: /
  • User-agent:
  • Disallow: /
  • User-agent:
  • Disallow: /
Back to top

Warnings

  • 1 invalid line.
Back to top