gotaylorsville.com
robots.txt

Robots Exclusion Standard data for gotaylorsville.com

Resource Scan

Scan Details

Site Domain gotaylorsville.com
Base Domain gotaylorsville.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-14T13:26:04+00:00
Next Scan 2024-12-13T13:26:04+00:00

Last Successful Scan

Scanned2023-11-20T06:25:17+00:00
URL https://gotaylorsville.com/robots.txt
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Response IP 54.151.156.30
Found Yes
Hash 31107dce3aa77c2746b72081a9fd0c6b9e8ce446f817f6699034126ce6be3307
SimHash 2f8037f29cb4

Groups

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

mediapartners-google

Rule Path
Disallow /includes/clicks.php?
Disallow /adform/IFrameManager.html
Disallow /admotion/afa-iframe.htm
Disallow /adrime/adrime_burst_2.0.0.htm
Disallow /adtech/iframeproxy.html
Disallow /bonzai/bonzaiBuster.html
Disallow /contobox/iframebuster.html
Disallow /doubleclick/adx_iframe.html
Disallow /doubleclick/DARTIframe.html
Disallow /exponential/buster.html
Disallow /eyeblaster/addineyeV2.html
Disallow /eyewonder/interim.html
Disallow /flashtalking/ftlocal.html
Disallow /flite/fif.html
Disallow /ipinyou/py_buster.html
Disallow /jivox/jivoxibuster.html
Disallow /knorex/knorex_psf.html
Disallow /kpsule/iframebuster.html
Disallow /linkstorm/linkstorm_certified.html
Disallow /liquidus/iframe.htm
Disallow /liquidus/iframeX.htm
Disallow /mediaplex/mojofb_v9.html
Disallow /mixpo/framebust.html
Disallow /pointroll/PointRollAds.htm
Disallow /predicta/predicta_bf.html
Disallow /revjet/revjet_buster.html
Disallow /rockabox/rockabox_buster.html
Disallow /sociomatic/iframebuster_Sociomantic.html
Disallow /spongecell/spongecell-spongecell_buster.html
Disallow /unicast/unicastIFD.html
Disallow /stubs/adform/IFrameManager.html
Disallow /stubs/admotion/afa-iframe.htm
Disallow /stubs/adrime/adrime_burst_2.0.0.htm
Disallow /stubs/adtech/iframeproxy.html
Disallow /stubs/bonzai/bonzaiBuster.html
Disallow /stubs/contobox/iframebuster.html
Disallow /stubs/doubleclick/adx_iframe.html
Disallow /stubs/doubleclick/DARTIframe.html
Disallow /stubs/exponential/buster.html
Disallow /stubs/eyeblaster/addineyeV2.html
Disallow /stubs/eyewonder/interim.html
Disallow /stubs/flashtalking/ftlocal.html
Disallow /stubs/flite/fif.html
Disallow /stubs/ipinyou/py_buster.html
Disallow /stubs/jivox/jivoxibuster.html
Disallow /stubs/knorex/knorex_psf.html
Disallow /stubs/kpsule/iframebuster.html
Disallow /stubs/linkstorm/linkstorm_certified.html
Disallow /stubs/liquidus/iframe.htm
Disallow /stubs/liquidus/iframeX.htm
Disallow /stubs/mediaplex/mojofb_v9.html
Disallow /stubs/mixpo/framebust.html
Disallow /stubs/pointroll/PointRollAds.htm
Disallow /stubs/predicta/predicta_bf.html
Disallow /stubs/revjet/revjet_buster.html
Disallow /stubs/rockabox/rockabox_buster.html
Disallow /stubs/sociomatic/iframebuster_Sociomantic.html
Disallow /stubs/spongecell/spongecell-spongecell_buster.html
Disallow /stubs/unicast/unicastIFD.html

Comments

  • Nofollow clicks.php
  • STUB files, 6/24/17