essayforum.com
robots.txt

Robots Exclusion Standard data for essayforum.com

Resource Scan

Scan Details

Site Domain essayforum.com
Base Domain essayforum.com
Scan Status Ok
Last Scan2026-01-24T06:23:39+00:00
Next Scan 2026-01-31T06:23:39+00:00

Last Scan

Scanned2026-01-24T06:23:39+00:00
URL https://essayforum.com/robots.txt
Domain IPs 72.52.132.38
Response IP 72.52.132.38
Found Yes
Hash 0995971af2ea7aa3127ebc48b17777b5b893169a579606ba3dd706a956a6b96a
SimHash 30548d42f212

Groups

*

Rule Path
Allow /shared_files/uploaded/*.*/*
Disallow /shared_files/uploaded/*/*.php$
Disallow /shared_files/checker/
Disallow /addon_captcha.php

mj12bot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

alibaba.com

Rule Path
Disallow /

aliyun

Rule Path
Disallow /

Comments

  • Disallow: /shared_files/uploaded/*/$
  • User-agent: Google-Extended
  • Disallow: /