Log In Sign Up

planetar.pt
robots.txt

Robots Exclusion Standard data for planetar.pt

Resource Scan

Scan Details

Site Domain planetar.pt
Base Domain planetar.pt
Scan Status Ok
Last Scan2025-12-05T11:41:52+00:00
Next Scan 2026-01-04T11:41:52+00:00

Last Scan

Scanned2025-12-05T11:41:52+00:00
URL https://planetar.pt/robots.txt
Domain IPs 104.21.38.99, 172.67.221.129, 2606:4700:3034::ac43:dd81, 2606:4700:3036::6815:2663
Response IP 172.67.221.129
Found Yes
Hash 6e050331aacc57ef2c8fa2532dfc622bd0efebe8947a0e76526d29e6dd42a9b0
SimHash 7f15ebe8dc8f

Groups

*

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /47837282454/checkouts
Disallow /47837282454/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop

adsbot-google

Rule Path
Disallow /checkouts/
Disallow /checkout
Disallow /carts
Disallow /orders
Disallow /47837282454/checkouts
Disallow /47837282454/orders
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /services/login_with_shop

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /47837282454/checkouts
Disallow /47837282454/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /cart
Disallow /orders
Disallow /checkouts/
Disallow /checkout
Disallow /47837282454/checkouts
Disallow /47837282454/orders
Disallow /carts
Disallow /account
Disallow /collections/*sort_by*
Disallow /*/collections/*sort_by*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /*/collections/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*/blogs/*%2B*
Disallow /*?*oseid=*
Disallow /*preview_theme_id*
Disallow /*preview_script_id*
Disallow /policies/
Disallow /*/policies/
Disallow /*/*?*ls=*&ls=*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /*/*?*ls%3D*%3Fls%3D*
Disallow /search
Disallow /apple-app-site-association
Disallow /.well-known/shopify/monorail
Disallow /cdn/wpm/*.js
Disallow /services/login_with_shop

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

smtbot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /

sitegurucrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

gptbot

Rule Path
Disallow /

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

psbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

screaming

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

shodan

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

sucuri

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

nessus

Rule Path
Disallow /

nikto

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

wpscan

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

buzzsumo

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

masscan

Rule Path
Disallow /

nmap

Rule Path
Disallow /

fimap

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

openvas

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

image sucker

Rule Path
Disallow /

pixray

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

autowebbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

datacha0s

Rule Path
Disallow /

dirbuster

Rule Path
Disallow /

getweb

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

backstreet

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

foobot

Rule Path
Disallow /

grapefx

Rule Path
Disallow /

black hole

Rule Path
Disallow /

internetseer

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

netspider

Rule Path
Disallow /

netzip

Rule Path
Disallow /

nutch

Rule Path
Disallow /

openfind

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

peoplepal

Rule Path
Disallow /

reaper

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scanbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebeam

Rule Path
Disallow /

sitevigil

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spider_bot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

stripper

Rule Path
Disallow /

sucker

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

voil

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

virusdie

Rule Path
Disallow /

wasalive-bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcollage

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webfuck

Rule Path
Disallow /

webimagecollector

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

websiteextractor

Rule Path
Disallow /

websitequester

Rule Path
Disallow /

webster

Rule Path
Disallow /

winhttrack

Rule Path
Disallow /

wprecon

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

zade

Rule Path
Disallow /

zermelo

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

autoemailspider

Rule Path
Disallow /

awario crawler

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

check1.exe

Rule Path
Disallow /

clark-crawler

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

crawler.feedback

Rule Path
Disallow /

dataforseo bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

demandbase-bot

Rule Path
Disallow /

domainsprojectbot

Rule Path
Disallow /

evc-batch

Rule Path
Disallow /

facebookscraper

Rule Path
Disallow /

gopher

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

instabid

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

iubenda-radar

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

lwp-request

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mediawords

Rule Path
Disallow /

muhstik-scan

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

openai

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

plumanalytics

Rule Path
Disallow /

probe-image-size

Rule Path
Disallow /

ripz

Rule Path
Disallow /

scan.lol

Rule Path
Disallow /

seobility

Rule Path
Disallow /

seocompany.store

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seostar

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sexsearcher

Rule Path
Disallow /

sitecheckerbot

Rule Path
Disallow /

siteripz

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

sp_auditbot

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

sysscan

Rule Path
Disallow /

webgains-bot

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

serendeputy

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

weborama

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

riddler

Rule Path
Disallow /

pr-cy.ru

Rule Path
Disallow /

linux mozilla

Rule Path
Disallow /

paloaltonetworks

Rule Path
Disallow /

backupland

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://planetar.pt/sitemap.xml
sitemap https://planetar.pt/sitemap.xml
sitemap https://planetar.pt/sitemap.xml
Back to top

Comments

  • we use Shopify as our ecommerce platform
  • Google adsbot ignores robots.txt unless specifically named!
Back to top

Warnings

  • 3 invalid lines.
Back to top