btprueba.com
robots.txt

Robots Exclusion Standard data for btprueba.com

Resource Scan

Scan Details

Site Domain btprueba.com
Base Domain btprueba.com
Scan Status Ok
Last Scan2024-11-13T17:10:47+00:00
Next Scan 2024-11-20T17:10:47+00:00

Last Scan

Scanned2024-11-13T17:10:47+00:00
URL https://btprueba.com/robots.txt
Domain IPs 104.21.33.5, 172.67.188.105, 2606:4700:3032::ac43:bc69, 2606:4700:3034::6815:2105
Response IP 104.21.33.5
Found Yes
Hash b47121915202127a4bc200fbbc40a00bf3db2409935ee4a035f0af6487acc691
SimHash cc9453c3c658

Groups

*

Rule Path
Disallow /

google

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

googlebot-image/1.0

Rule Path
Disallow /

googlebot-news

Rule Path
Disallow /

googlebot/2.1 (+http://www.googlebot.com/bot.html)

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /

adsbot-google-mobile

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow /

googlebot-video

Rule Path
Disallow /

googlebot-video/1.0

Rule Path
Disallow /

adsbot-google-mobile-apps

Rule Path
Disallow /

adsbot-google (+http://www.google.com/adsbot.html)

Rule Path
Disallow /

duplexweb-google

Rule Path
Disallow /

googleweblight

Rule Path
Disallow /

storebot-google

Rule Path
Disallow /

mozilla/5.0 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow /

samsung-sgh-e250/1.0 profile/midp-2.0 configuration/cldc-1.1 up.browser/6.2.3.3.c.1.101 (gui) mmp/2.0 (compatible; googlebot-mobile/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow /

mozilla/5.0 (linux; android 6.0.1; nexus 5x build/mmb29p) applewebkit/537.36 (khtml, like gecko) chrome/41.0.2272.96 mobile safari/537.36 (compatible; googlebot/2.1; +http://www.google.com/bot.html)

Rule Path
Disallow /

google-read-aloud

Rule Path
Disallow /

google favicon

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

mozilla/5.0 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Rule Path
Disallow /

mozilla/5.0 (compatible; bingbot/2.0 +http://www.bing.com/bingbot.htm)

Rule Path
Disallow /

mozilla/5.0 (windows phone 8.1; arm; trident/7.0; touch; rv:11.0; iemobile/11.0; nokia; lumia 530) like gecko (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Rule Path
Disallow /

mozilla/5.0 (iphone; cpu iphone os 7_0 like mac os x) applewebkit/537.51.1 (khtml, like gecko) version/7.0 mobile/11a465 safari/9537.53 (compatible; bingbot/2.0; +http://www.bing.com/bingbot.htm)

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

telegrambot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

applebot
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
ia_archiver
msnbot/2.0b (+http://search.msn.com/msnbot.htm)
msnbot-media/1.1 (+http://search.msn.com/msnbot.htm)
twitterbot
mozilla/5.0 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
mozilla/5.0 (iphone; cpu iphone os 7_0 like mac os x) applewebkit/537.51.1 (khtml, like gecko) version/7.0 mobile/11a465 safari/9537.53 (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
mozilla/5.0 (windows phone 8.1; arm; trident/7.0; touch; rv:11.0; iemobile/11.0; nokia; lumia 530) like gecko (compatible; adidxbot/2.0; +http://www.bing.com/bingbot.htm)
mozilla/5.0 (windows nt 6.1; wow64) applewebkit/534+ (khtml, like gecko) bingpreview/1.0b
mozilla/5.0 (windows phone 8.1; arm; trident/7.0; touch; rv:11.0; iemobile/11.0; nokia; lumia 530) like gecko bingpreview/1.0b
mozilla/5.0 (compatible; yahoo! slurp; http://help.yahoo.com/help/us/ysearch/slurp)
duckduckbot/1.0; (+http://duckduckgo.com/duckduckbot.html)
duckduckbot
twitterbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

Warnings

  • 2 invalid lines.