Log In Sign Up

transfernow.net
robots.txt

Robots Exclusion Standard data for transfernow.net

Resource Scan

Scan Details

Site Domain transfernow.net
Base Domain transfernow.net
Scan Status Ok
Last Scan2024-06-20T19:48:02+00:00
Next Scan 2024-06-27T19:48:02+00:00

Last Scan

Scanned2024-06-20T19:48:02+00:00
URL https://transfernow.net/robots.txt
Redirect https://www.transfernow.net:443/robots.txt
Redirect Domain www.transfernow.net
Redirect Base transfernow.net
Domain IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Redirect IPs 104.26.14.166, 104.26.15.166, 172.67.72.33, 2606:4700:20::681a:ea6, 2606:4700:20::681a:fa6, 2606:4700:20::ac43:4821
Response IP 104.26.14.166
Found Yes
Hash ed99b4b7076fc25901824641b56e77e3dd65ca0ca2d78f36aa9228d30d16047e
SimHash a09a79d3afd0

Groups

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /cdn/brands/

*

Rule Path
Disallow /cdn/pdf/
Back to top

Other Records

Field Value
sitemap https://www.transfernow.net/sitemap.xml
Back to top

Comments

  • robots.txt for https://www.transfernow.net
  • _ __ _
  • | | / _| | |
  • | |_ _ __ __ _ _ __ ___| |_ ___ _ __ _ __ _____ ___ __ ___| |_
  • | __| '__/ _` | '_ \/ __| _/ _ \ '__| '_ \ / _ \ \ /\ / / '_ \ / _ \ __|
  • | |_| | | (_| | | | \__ \ || __/ | | | | | (_) \ V V /| | | | __/ |_
  • \__|_| \__,_|_| |_|___/_| \___|_| |_| |_|\___/ \_/\_(_)_| |_|\___|\__|
Back to top