getapp.com
robots.txt

Robots Exclusion Standard data for getapp.com

Resource Scan

Scan Details

Site Domain getapp.com
Base Domain getapp.com
Scan Status Ok
Last Scan2025-12-23T21:48:12+00:00
Next Scan 2026-01-06T21:48:12+00:00

Last Scan

Scanned2025-12-23T21:48:12+00:00
URL https://getapp.com/robots.txt
Redirect https://www.getapp.com/robots.txt
Redirect Domain www.getapp.com
Redirect Base getapp.com
Domain IPs 104.18.41.69, 172.64.146.187, 2606:4700:4405::ac40:92bb, 2a06:98c1:3109::6812:2945
Redirect IPs 104.18.41.69, 172.64.146.187, 2606:4700:4405::ac40:92bb, 2a06:98c1:3109::6812:2945
Response IP 172.64.146.187
Found Yes
Hash aa05c9efdc8e3125e3fce0b600be4576589b8dc0b9393ed00d87ebc1f2d1b9c7
SimHash 6ad29953cee1

Groups

*

Rule Path
Disallow /*-software/a/*/compare/*-vs-*/
Disallow /s/
Disallow /z/*?*
Disallow /1255036/
Disallow /ac?*
Disallow /autocomplete
Disallow /api/*
Disallow /apiui/*
Disallow /next/*
Disallow /compare/search*?*
Disallow /community/
Disallow /conversion/
Disallow /ext/
Disallow /profile/tmp/me
Disallow /s/*-slash-flash-*
Disallow /listing_view/
Disallow /p/sem/
Disallow /resources/preview
Disallow /cdn-cgi/
Disallow /?open_login=1

bingbot

Rule Path
Disallow /*?*
Disallow /*-software/a/*/compare/*-vs-*/
Disallow /1255036/
Disallow /autocomplete
Disallow /community/
Disallow /conversion/
Disallow /ext/
Disallow /profile/tmp/me
Disallow /s/*-slash-flash-*
Disallow /listing_view/

yahoo! slurp

Rule Path
Disallow /*?*

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow /*?*

Other Records

Field Value
crawl-delay 10

ubicrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

vegi

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

applebot-extended
arquivo-web-crawler
archive.org_bot
bytespider
ccbot
claudebot
crawlspace
diffbot
meta-externalagent
pangubot
timpibot
yandexadditional
yandexadditionalbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.getapp.com/sitemaps/sitemap.xml
sitemap https://www.getapp.com/sitemaps/comparisons/sitemap-index.xml
sitemap https://www.getapp.com/sitemaps/resources/sitemap-index.xml
sitemap https://www.getapp.com/sitemaps/categories/integrated-with/sitemap-index.xml
sitemap https://www.getapp.com/sitemaps/categories/feature-tags/sitemap-index.xml
sitemap https://www.getapp.com/sitemaps/profiles/sitemap-index.xml
sitemap https://www.getapp.com/sitemaps/profiles/alternatives/sitemap-index.xml

Comments

  • Blocks crawlers that are kind enough to obey robots