sinonimosgratis.com
robots.txt

Robots Exclusion Standard data for sinonimosgratis.com

Resource Scan

Scan Details

Site Domain sinonimosgratis.com
Base Domain sinonimosgratis.com
Scan Status Ok
Last Scan2024-10-04T06:46:58+00:00
Next Scan 2024-10-11T06:46:58+00:00

Last Scan

Scanned2024-10-04T06:46:58+00:00
URL https://sinonimosgratis.com/robots.txt
Redirect https://www.sinonimosgratis.com/robots.txt
Redirect Domain www.sinonimosgratis.com
Redirect Base sinonimosgratis.com
Domain IPs 108.181.102.67
Redirect IPs 108.181.102.67
Response IP 108.181.102.66
Found Yes
Hash c0f6adbe7aa0cd09ddc85f7f5e421d60671cf97ec9b4ee0109f212e95c4a8e38
SimHash 45dece50b390

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /p/
Disallow /d/
Disallow /_/misc/
Disallow /_/search/
Disallow /_/cite.htm
Disallow /_/gr.aspx
Disallow /_/hp/Controls/printer-friendly.aspx
Disallow /unscramble/

aihitbot
barkrowler
bdcbot
blexbot
blp_bbot
brokenlinkcheck.com
buck
ccbot
cliqzbot
cyencebot
domaincrawler
dow jones searchbot
exabot
extlinksbot
femtosearchbot
fever
garlikcrawler
gigabot
gobuster
grapeshotcrawler
heritrix
istellabot
jersey
jobkicks
libwww-perl
linkdexbot
linkpadbot
ltx71 - (http://ltx71.com/)
lua-resty-http
lumtelbot
magpie-crawler
magus bot
megaindex.ru
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) linkcheck by siteimprove.com
mozilla/5.0 (compatible; msie 10.0; windows nt 6.1; trident/6.0) sitecheck-sitecrawl by siteimprove.com
nl-crawler
onpagebot
riddler
scoutjet
scrapy
seekport
siteimprove
smtbot
uptimerobot
velenpublicwebcrawler
wget
yacybot
yunsecuritybot
zoominfobot
ahrefsbot
ahrefssiteaudit
caliperbot
dotbot
hubspot
mj12bot
rogerbot
semrushbot
gptbot

Rule Path
Disallow /

yisouspider
yeti
seznambot
mail.ru_bot
hatena*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://www.sinonimosgratis.com/www.sinonimosgratis.com.xml.gz