Log In Sign Up

percona.com
robots.txt

Robots Exclusion Standard data for percona.com

Resource Scan

Scan Details

Site Domain percona.com
Base Domain percona.com
Scan Status Ok
Last Scan2024-06-26T18:02:55+00:00
Next Scan 2024-07-10T18:02:55+00:00

Last Scan

Scanned2024-06-26T18:02:55+00:00
URL https://percona.com/robots.txt
Domain IPs 23.23.141.226, 34.232.180.52, 44.207.71.84
Response IP 44.207.71.84
Found Yes
Hash 94d817b2c199c0d5597d262e21e351c7f046866d9341864de0b3ea3d64d57731
SimHash 5dde6e112780

Groups

aihitbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

brokenlinkcheck.com

Rule Path
Disallow /

buck

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

cyencebot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

dow jones searchbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

fever

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

gobuster

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

jersey

Rule Path
Disallow /

jobkicks

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

lua-resty-http

Rule Path
Disallow /

lumtelbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

magus bot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

nl-crawler

Rule Path
Disallow /

onpagebot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

seekport

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

siteimprove

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

wget

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

yunsecuritybot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

*

Rule Path
Disallow /search*
Back to top

Other Records

Field Value
sitemap https://www.percona.com/sitemap.xml
Back to top

Comments

  • -- LAST MODIFIED DATE 29-03-2023 --
  • -- XML Sitemap Location --
  • --------------------------------
Back to top