vnnforum.com
robots.txt

Robots Exclusion Standard data for vnnforum.com

Resource Scan

Scan Details

Site Domain vnnforum.com
Base Domain vnnforum.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-06T03:27:47+00:00
Next Scan 2026-02-04T03:27:47+00:00

Last Successful Scan

Scanned2024-03-23T01:05:25+00:00
URL https://vnnforum.com/robots.txt
Domain IPs 104.21.56.109, 172.67.184.165, 2606:4700:3032::6815:386d, 2606:4700:3036::ac43:b8a5
Response IP 172.67.184.165
Found Yes
Hash ee199331b3d5d2a85b061c439775cea25f15cfb8cd8e3af581000207ddaa18aa
SimHash 2e1eea01c386

Groups

*

Rule Path
Disallow /ajax.php
Disallow /attachment.php
Disallow /blog.php
Disallow /calendar.php
Disallow /cron.php
Disallow /phpinfo.php
Disallow /editpost.php
Disallow /global.php
Disallow /image.php
Disallow /inlinemod.php
Disallow /userlogin.php
Disallow /joinrequests.php
Disallow /login.php
Disallow /member.php
Disallow /memberlist.php
Disallow /misc.php
Disallow /moderator.php
Disallow /newattachment.php
Disallow /newreply.php
Disallow /newthread.php
Disallow /online.php
Disallow /poll.php
Disallow /postings.php
Disallow /printthread.php
Disallow /private.php
Disallow /profile.php
Disallow /register.php
Disallow /report.php
Disallow /reputation.php
Disallow /search.php
Disallow /sendmessage.php
Disallow /showgroups.php
Disallow /subscription.php
Disallow /threadrate.php
Disallow /usercp.php
Disallow /usernote.php
Disallow /banner/ticker/

slurp

Rule Path
Disallow /search.php

Other Records

Field Value
crawl-delay 120

whitevector crawler

Rule Path
Disallow /

huaweisymantecspider

Rule Path
Disallow /

sitebot/0.1

Rule Path
Disallow /

discobot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 260

yandeximages/3.0

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 260

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 260

mj12bot

Rule Path
Disallow /

teoma

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 260

sitebot

Rule Path
Disallow /

gigabot/3.0

Rule Path
Disallow /

exabot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

sogou

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

gogospider

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

squadbot/1.0

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

radien6

Rule Path
Disallow /

genieo

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Warnings

  • 2 invalid lines.