teds.com.au
robots.txt

Robots Exclusion Standard data for teds.com.au

Resource Scan

Scan Details

Site Domain teds.com.au
Base Domain teds.com.au
Scan Status Ok
Last Scan2024-10-30T00:39:41+00:00
Next Scan 2024-11-29T00:39:41+00:00

Last Scan

Scanned2024-10-30T00:39:41+00:00
URL https://teds.com.au/robots.txt
Redirect https://www.teds.com.au/robots.txt
Redirect Domain www.teds.com.au
Redirect Base teds.com.au
Domain IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 2baddbbd5f769292044579490f45804dea0f4d00d88c1e6ccbe5866ad3bc51b0
SimHash 61b514008a88

Groups

petalbot
mj12bot
ahrefsbot
test-bot
my-tiny-bot
fidget-spinner-bot
gptbot
thesis-research-bot
yandexbot
yandexnews
yandexrenderresourcesbot
ezlynx
ezoicbot
awariobot
awariorssbot
awariosmartbot

Rule Path
Disallow /

*

Rule Path
Disallow /lib/
Disallow /*.php$
Disallow /pkginfo/
Disallow /report/
Disallow /var/
Disallow /customer/
Disallow /sendfriend/
Disallow /review/
Disallow /*SID%3D
Disallow /catalogsearch/
Disallow /*?*product_list_order=*
Disallow /*?*product_list_dir=*
Disallow /*?*cat=*
Disallow /*?*battery_type=*
Disallow /*?*charger=*
Disallow /*?*color=*
Disallow /*?*condition=*
Disallow /*?*continuous_speed=*
Disallow /*?*image_stabiliser=*
Disallow /*?*lcd_size=*
Disallow /*?*lens_mount=*
Disallow /*?*lens_type=*
Disallow /*?*magnification=*
Disallow /*?*manufacturer=*
Disallow /*?*max_shutter_speed=*
Disallow /*?*mega_pixels=*
Disallow /*?*memory_card_capacity=*
Disallow /*?*memory_type=*
Disallow /*?*min_shutter=*
Disallow /*?*objective_lens=*
Disallow /*?*optical_zoom=*
Disallow /*?*price=*
Disallow /*?*screen_size=*
Disallow /*?*sensor_size=*
Disallow /*?*video_resolution=*
Disallow /*?*viewfinder=*
Disallow /*?*waterproof=*

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 90

applebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

ahrefssiteaudit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

applewebkit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

adsbot-google-mobile

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

klarnabot-pricewatcher

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

pinterestbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

adsbot-google

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

googlebot-image

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

particularaudiencebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

twitterbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

domainstatsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

uptimerobot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

duckduckbot-https

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

facebookexternalhit

Rule Path
Allow /

Other Records

Field Value
crawl-delay 30

semrushbot

Rule Path
Disallow /

pingdombot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

vebot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

ezlynx

Rule Path
Disallow /

pingdom.com_bot_version_1.4_

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

staticicebot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

yak

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

tineye-bot-live

Rule Path
Disallow /

slackbot-linkexpanding

Rule Path
Disallow /

nimbostratus-bot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

firmupbot

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

yellowbrandprotectionbot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

whatyoutypebot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

restsharp

Rule Path
Disallow /

nodeping

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.teds.com.au/media/sitemaps/sitemap.xml