gsmchoice.com
robots.txt

Robots Exclusion Standard data for gsmchoice.com

Resource Scan

Scan Details

Site Domain gsmchoice.com
Base Domain gsmchoice.com
Scan Status Ok
Last Scan2024-06-12T21:56:47+00:00
Next Scan 2024-06-19T21:56:47+00:00

Last Scan

Scanned2024-06-12T21:56:47+00:00
URL https://gsmchoice.com/robots.txt
Domain IPs 51.195.211.149
Response IP 51.195.211.149
Found Yes
Hash 7702de53e19fa4e011ae7911b46053c504718c25d63aa3ca85b448954aa62c00
SimHash c32c1fc6473c

Groups

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

bingbot
duckduckbot
applebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

dotbot

Product Comment
dotbot bot z moz.com
Rule Path
Disallow /

awariosmartbot
awariosmartbot
ccbot

Rule Path
Disallow /

chimebot
gg peekbot
gumgum bot

Rule Path
Disallow /

mediatoolkitbot
blexbot
bomborabot

Rule Path
Disallow /

discordbot
linkdexbot
mail.ru_bot

Rule Path
Disallow /

mj12bot
seokicks
seokicks-robot
seznambot

Rule Path
Disallow /

yak
petalbot
moatbot

Rule Path
Disallow /

tweetmemebot
trendictionbot
leikibot

Rule Path
Disallow /

uptimerobot/2.0
quantcastbot
scooperbot

Rule Path
Disallow /

sentibot
sentibot
sirdatabot
slackbot
slack-imgproxy

Rule Path
Disallow /

zoominfobot
criteobot/0.1

Rule Path
Disallow /

*

Rule Path
Disallow /gizmo/
Disallow /pic/CVS/
Disallow /pic/ads_imgs/
Disallow /pic/apple_ads/
Disallow /pic/brands/
Disallow /pic/friends/
Disallow /pic/gielda/
Disallow /pic/gsmchoice/
Disallow /pic/icons/
Disallow /pic/naviexpert/
Disallow /pic/news/
Disallow /pic/reklama/
Disallow /pic/slowniczek/
Disallow /pic/users_avatars/
Disallow /pic/users_imgs/
Disallow /pic/users_img_tmp/
Disallow /me/
Disallow /pic/*.gif$
Disallow /pic/*.png$
Disallow /imager_res/
Disallow /soap/
Disallow /CVS/
Disallow /monitor/
Disallow /fun/
Disallow /*porownania/
Disallow /*advanced_search/
Allow /

googlebot-image

Rule Path
Allow /
Allow /pic/phones/

mediapartners-google

Rule Path
Disallow

googlebot-news

Rule Path
Allow /news
Allow /test
Allow /phones

googlebot-image

Rule Path
Allow /news
Allow /test
Allow /phones

googlebot

Rule Path
Allow /news
Allow /test
Allow /phones

googlebot-video

Rule Path
Allow /news
Allow /test
Allow /phones

googlebot-mobile

Rule Path
Allow /news
Allow /test
Allow /phones
Allow /icons

googlebot-news

Rule Path
Allow /news
Allow /test
Allow /pic/phones

googlebot-image

Rule Path
Allow /news
Allow /test
Allow /pic/phones

googlebot

Rule Path
Allow /news
Allow /test
Allow /pic/phones

googlebot-video

Rule Path
Allow /news
Allow /test
Allow /pic/phones

googlebot-mobile

Rule Path
Allow /news
Allow /test
Allow /phones
Allow /pic/icons

googlebot

Rule Path
Disallow /*bookmarks/
Disallow /trabka/
Disallow /*pl/katalog/samsung/gti8000omnia2/zdjecia/
Disallow /*?style=old
Disallow /*?style=new

Other Records

Field Value
sitemap https://www.mgsm.pl/sitemap-index.xml
sitemap https://www.mgsm.pl/sitemap-index.xml

Comments

  • https://webmaster.petalsearch.com/site/petalbot
  • Disallow: /pic/phones/
  • Sitemap: https://gsmchoice.com/sitemap-index.xml