vtrinn.com
robots.txt

Robots Exclusion Standard data for vtrinn.com

Resource Scan

Scan Details

Site Domain vtrinn.com
Base Domain vtrinn.com
Scan Status Ok
Last Scan2024-09-14T19:36:48+00:00
Next Scan 2024-09-21T19:36:48+00:00

Last Scan

Scanned2024-09-14T19:36:48+00:00
URL https://vtrinn.com/robots.txt
Domain IPs 34.160.17.71, 35.190.31.54, 35.227.194.51, 35.244.153.44
Response IP 34.149.120.3
Found Yes
Hash 2378fe4e021473884287e32a67b27516e8e19bc2789e5c952b3a4b5356897a51
SimHash 8a345480ce9a

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /scripts/
Disallow /wp-includes/
Disallow /js/
Disallow /themes/
Disallow /tmp/
Disallow /wp-login/
Disallow /wp-content/uploads/wpo-plugins-tables-list.json
Disallow /wp-json/wp/v2/users/1
Disallow /wp-login.php
Disallow /?q=admin%2F
Disallow /?q=comment%2Freply%2F
Disallow /?q=filter%2Ftips%2F
Disallow /?q=node%2Fadd%2F
Disallow /?q=search%2F
Disallow /?q=user%2Fpassword%2F
Disallow /?q=user%2Fregister%2F
Disallow /?q=user%2Flogin%2F
Disallow /?q=user%2Flogout%2F
Disallow /CHANGELOG.txt
Disallow /cron.php
Disallow /INSTALL.mysql.txt
Disallow /INSTALL.pgsql.txt
Disallow /INSTALL.sqlite.txt
Disallow /install.php
Disallow /INSTALL.txt
Disallow /LICENSE.txt
Disallow /MAINTAINERS.txt
Disallow /update.php
Disallow /UPGRADE.txt
Disallow /xmlrpc.php

nutch

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

blackboard safeassign

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

timpibot/0.8

Rule Path
Disallow /

tinytestbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

awariobot/1.0

Rule Path
Disallow /

awariosmartbot/1.0

Rule Path
Disallow /

awariorssbot/1.0

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vtrinn.com/sitemap.xml

Comments

  • Paths (no clean URLs)
  • Files
  • Block bots