Log In Sign Up

airoomplanner.com
robots.txt

Robots Exclusion Standard data for airoomplanner.com

Resource Scan

Scan Details

Site Domain airoomplanner.com
Base Domain airoomplanner.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-05-20T15:43:40+00:00
Next Scan 2024-08-18T15:43:40+00:00

Last Successful Scan

Scanned2023-07-26T03:41:14+00:00
URL http://airoomplanner.com/robots.txt
Domain IPs 157.230.160.218
Response IP 157.230.160.218
Found Yes
Hash 9f23d6b420860e6ba4709cff1d4af1c00990d134fa24f6e074ac8d54a071d0cb
SimHash 6bc6f340d515

Groups

*

Rule Path
Allow /interiorai/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

leikibot

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

mediatoolkitbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yak

Rule Path
Allow /

trendictionbot

Rule Path
Allow /

adstxtcrawler

Rule Path
Allow /ads.txt

disqusadstxtcrawler

Rule Path
Allow /ads.txt

adsbot

Rule Path
Allow /ads.txt

centro ads.txt crawler

Rule Path
Allow /ads.txt

iab atq team adform robot

Rule Path
Allow /ads.txt

grapeshotcrawler

Rule Path
Allow /

slurp

Rule Path
Allow /

bingbot

Rule Path
Allow /

surdotlybot

Rule Path
Allow /

applebot

Rule Path
Allow /

mojeekbot

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

twitterbot

Rule Path
Allow /

telegrambot

Rule Path
Allow /

twittermemebot

Rule Path
Allow /

discordbot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

datagnionbot

Rule Path
Allow /

barkrowler

Rule Path
Allow /

ias_crawler

Rule Path
Allow /

bidswitchbot

Rule Path
Allow /ads.txt

pulsepoint-ads

Rule Path
Allow /ads.txt

petalbot

Rule Path
Allow /

awariorssbot
awariosmartbot

Rule Path
Allow /

zoominfobot

Rule Path
Allow /

criteobot/0.1

Rule Path
Allow /

linespider/1.1

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://musiccoder.com/sitemap.xml
Back to top

Comments

  • This is a comment.
  • Disallow every bot from scraping/indexing the entire site.
  • User-agent: *
  • Disallow: /
  • Google's general bot
  • Google Image bot
  • Google News bot
  • DoubleVerify bot
  • Google Video bot
  • Google Adsense bot
  • media toolkit bot
  • Google's bot to check desktop web page ad quality
  • Google's bot to check mobile web page ad quality
  • Yandex bot (russia search engine)
  • Linkfluence bot
  • trendiction bot
  • Allow only for ads.txt
  • Oracle crawler
  • Yahoo bot
  • Microsoft Bing bot
  • SudortlyBot
  • Applebot
  • Mojeek bot
  • DuckDuckGo bot
  • Exalead bot
  • Facebook bot
  • Facebook bot
  • Twitter bot
  • Telegram bot
  • Twitter bot
  • Discord bot
  • Amazon Alexa bot
  • dataognion bot
  • Barbar tech bot
  • IAS Crawler
  • https://integralads.com/site-indexing-policy/
  • bidswitch bot
  • Pulsepoint
  • Petal search engine
  • Awario
  • Zoominfobot
  • Criteobot
  • LINE
  • Sitemap location
Back to top