Log In Sign Up

reviewster.com
robots.txt

Robots Exclusion Standard data for reviewster.com

Resource Scan

Scan Details

Site Domain reviewster.com
Base Domain reviewster.com
Scan Status Ok
Last Scan2026-02-20T12:34:48+00:00
Next Scan 2026-02-27T12:34:48+00:00

Last Scan

Scanned2026-02-20T12:34:48+00:00
URL https://reviewster.com/robots.txt
Domain IPs 104.21.5.151, 172.67.154.186, 2606:4700:3030::6815:597, 2606:4700:3037::ac43:9aba
Response IP 104.21.5.151
Found Yes
Hash 936f8ccec457cd4ca61bb90b967702ff116c3fae199f941d97f1fd6d1c9239e2
SimHash 648acec145b2

Groups

lumen*

Rule Path
Disallow /

lumenapi*

Rule Path
Disallow /

dmcabot*

Rule Path
Disallow /

dmca*

Rule Path
Disallow /

legal*

Rule Path
Disallow /

chillingeffects*

Rule Path
Disallow /

copyscape*

Rule Path
Disallow /

plagiarismbot*

Rule Path
Disallow /

dmcachecker*

Rule Path
Disallow /

copyrightbot*

Rule Path
Disallow /

antipiracybot*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://reviewster.com/sitemap.xml
Back to top

Comments

  • =========================
  • Blokir semua varian Lumen & DMCA bots
  • =========================
  • =========================
  • Izinkan semua search engine resmi
  • =========================
  • =========================
  • Sitemap website
  • =========================
Back to top