elgg.org
robots.txt

Robots Exclusion Standard data for elgg.org

Resource Scan

Scan Details

Site Domain elgg.org
Base Domain elgg.org
Scan Status Ok
Last Scan2024-09-28T07:58:24+00:00
Next Scan 2024-10-28T07:58:24+00:00

Last Scan

Scanned2024-09-28T07:58:24+00:00
URL https://elgg.org/robots.txt
Domain IPs 140.211.15.97
Response IP 140.211.15.97
Found Yes
Hash 0163c1a1e8a40a31982e950fe4a9e35e4a523ecf2ce430924e6349a97e7f8e61
SimHash d31cc028ee8a

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

*

Rule Path
Disallow /search
Disallow /register/

*

Rule Path
Disallow /search/

Warnings

  • 1 invalid line.