horrorforum.com
robots.txt

Robots Exclusion Standard data for horrorforum.com

Resource Scan

Scan Details

Site Domain horrorforum.com
Base Domain horrorforum.com
Scan Status Ok
Last Scan2025-12-20T11:19:40+00:00
Next Scan 2025-12-27T11:19:40+00:00

Last Scan

Scanned2025-12-20T11:19:40+00:00
URL https://horrorforum.com/robots.txt
Domain IPs 192.96.218.78
Response IP 192.96.218.78
Found Yes
Hash 7b726c700c42034188e4a7305a5ec601a7a11780f8e4c0dffa64f177379c7f42
SimHash 211e60f04655

Groups

baiduspider
bingbot
duckduckbot
exabot
facebookexternalhit
feedfetcher-google
google-inspectiontool
google-site-verification
google-speakr
googlebot
googlebot-image
googlebot-news
googlebot-video
mediapartners-google
msnbot
qwantify
speedyspider
twitterbot
yandexantivirus/2.0
yandexbot/3.0
yandeximageresizer/2.0
yandeximages/3.0
yandexmedia/3.0
yandexpagechecker/1.0
yandexwebmaster/2.0
yandexzakladki/3.0

Rule Path
Disallow /cgi-bin/
Disallow /admin/
Disallow /archive/
Disallow /cache/
Disallow /documentation/
Disallow /inc/
Disallow /install/
Disallow /merge/
Disallow /upload/
Disallow /uploads/
Disallow /attachment.php
Disallow /calendar.php
Disallow /captcha.php
Disallow /contact.php
Disallow /css.php
Disallow /editpost.php
Disallow /global.php
Disallow /member.php?*
Disallow /memberlist.php
Disallow /misc.php?*
Disallow /modcp.php
Disallow /moderation.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /portal.php
Disallow /printthread.php
Disallow /private.php
Disallow /ratethread.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendthread.php
Disallow /stats.php
Disallow /task.php
Disallow /usercp.php
Disallow /warnings.php

ahrefsbot
ccbot/2.0
chatgpt-user
google-cloudvertexbot
google-extended
googleother
mj12bot
mojeekbot
petalbot
semrushbot
similarweb
yepbot
youbot
*

Rule Path
Disallow /

Comments

  • robots.txt file for http://www.horrorforum.com/
  • Allow the good bots in
  • Block the well-behaved unwanted bots