ponss.it
robots.txt

Robots Exclusion Standard data for ponss.it

Resource Scan

Scan Details

Site Domain ponss.it
Base Domain ponss.it
Scan Status Ok
Last Scan2024-10-05T13:18:08+00:00
Next Scan 2024-10-12T13:18:08+00:00

Last Scan

Scanned2024-10-05T13:18:08+00:00
URL https://ponss.it/robots.txt
Redirect https://www.ponss.it/robots.txt
Redirect Domain www.ponss.it
Redirect Base ponss.it
Domain IPs 92.246.101.76
Redirect IPs 92.246.101.76
Response IP 92.246.101.76
Found Yes
Hash 99c544e2c40d744248a21881f93b01f06a59c8733f6802137bba70f22052f086
SimHash 58dece50afb0

Groups

*

Rule Path
Disallow /backoffice/

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (http://ltx71.com/)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
mail.ru_bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
seznambot
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yeti
yisouspider
yunsecuritybot
zoominfobot

Rule Path
Disallow /

ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.ponss.it/sitemap.xml

Comments

  • -- Spam Bots & Other Unwanted Bots --
  • -- SEO Tools & Service - Set Crawl Delay for Optimal Performance --