Log In Sign Up

polcode.com
robots.txt

Robots Exclusion Standard data for polcode.com

Resource Scan

Scan Details

Site Domain polcode.com
Base Domain polcode.com
Scan Status Ok
Last Scan2024-08-30T14:11:21+00:00
Next Scan 2024-09-29T14:11:21+00:00

Last Scan

Scanned2024-08-30T14:11:21+00:00
URL https://polcode.com/robots.txt
Domain IPs 52.84.45.126, 52.84.45.34, 52.84.45.4, 52.84.45.64
Response IP 3.160.246.65
Found Yes
Hash 4f5ffc81be2feb5cc4ff67c86eb00854f221b0d4c04a79cad32742b659a48a50
SimHash a159b61f8e2b

Groups

*

Rule Path
Disallow /*.pdf$
Disallow /*.zip$
Disallow /*.docs$
Disallow /*.gif$
Disallow /*.png$
Disallow /*.jpg$
Disallow /*.jpeg$
Disallow /*.svg$
Disallow /*.js$
Disallow /*.css$

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

custo

Rule Path
Disallow /

disco

Rule Path
Disallow /

download demon

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

express webpictures

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

flashget

Rule Path
Disallow /

getright

Rule Path
Disallow /

getweb!

Rule Path
Disallow /

go!zilla

Rule Path
Disallow /

go-ahead-got-it

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

hmview

Rule Path
Disallow /

httrack

Rule Path
Disallow /

image stripper

Rule Path
Disallow /

image sucker

Rule Path
Disallow /

indy library

Rule Path
Disallow /

interget

Rule Path
Disallow /

internet ninja

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

joc web spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

mass downloader

Rule Path
Disallow /

midown tool

Rule Path
Disallow /

misterpix

Rule Path
Disallow /

navroad

Rule Path
Disallow /

nearsite

Rule Path
Disallow /

netants

Rule Path
Disallow /

netspider

Rule Path
Disallow /

netvampire

Rule Path
Disallow /

netzip

Rule Path
Disallow /

octopus

Rule Path
Disallow /

offlineexplorer

Rule Path
Disallow /

offlinenavigator

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

papafoto

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

reget

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

surfbot

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

voideye

Rule Path
Disallow /

webimagecollector

Rule Path
Disallow /

websucker

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webgois

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

websiteextractor

Rule Path
Disallow /

websitequester

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

widow

Rule Path
Disallow /

wwwoffle

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://polcode.com/sitemap.xml
Back to top

Comments

  • *
  • Rogerbot
  • Exabot
  • MJ12bot
  • Dotbot
  • Gigabot
  • BlackWidow
  • ChinaClaw
  • Custo
  • DISCo
  • Download Demon
  • eCatch
  • EirGrabber
  • EmailSiphon
  • EmailWolf
  • Express WebPictures
  • ExtractorPro
  • EyeNetIE
  • FlashGet
  • GetRight
  • GetWeb!
  • Go!Zilla
  • Go-Ahead-Got-It
  • GrabNet
  • Grafula
  • HMView
  • HTTrack
  • Image Stripper
  • Image Sucker
  • Indy Library
  • InterGET
  • Internet Ninja
  • JetCar
  • JOC Web Spider
  • larbin
  • LeechFTP
  • Mass Downloader
  • MIDown tool
  • MisterPiX
  • Navroad
  • NearSite
  • NetAnts
  • NetSpider
  • NetVampire
  • NetZIP
  • Octopus
  • OfflineExplorer
  • OfflineNavigator
  • PageGrabber
  • PapaFoto
  • pavuk
  • pcBrowser
  • RealDownload
  • ReGet
  • SiteSnagger
  • SmartDownload
  • SuperBot
  • SuperHTTP
  • Surfbot
  • tAkeOut
  • TeleportPro
  • VoidEYE
  • WebImageCollector
  • WebSucker
  • WebAuto
  • WebCopier
  • WebFetch
  • WebGoIS
  • WebLeacher
  • WebReaper
  • WebSauger
  • WebsiteeXtractor
  • WebsiteQuester
  • WebStripper
  • WebWhacker
  • WebZIP
  • Wget
  • Widow
  • WWWOFFLE
  • Xaldon WebSpider
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top