Log In Sign Up

mondayitis.app
robots.txt

Robots Exclusion Standard data for mondayitis.app

Resource Scan

Scan Details

Site Domain mondayitis.app
Base Domain mondayitis.app
Scan Status Ok
Last Scan2025-08-27T05:53:53+00:00
Next Scan 2025-09-03T05:53:53+00:00

Last Scan

Scanned2025-08-27T05:53:53+00:00
URL https://mondayitis.app/robots.txt
Domain IPs 104.21.7.187, 172.67.137.47, 2606:4700:3036::6815:7bb, 2606:4700:3037::ac43:892f
Response IP 104.21.7.187
Found Yes
Hash 9bd3a1912525cf5ac558a5d19b50f441b8ce742f019a661c4ce838a54c909db8
SimHash 24319b00e1e0

Groups

adsbot-google
adsbot-google-mobile
adsbot-google-mobile-apps
adidxbot
applebot
applenewsbot
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
bingbot
bingpreview
bublupbot
ccbot
cliqzbot
coccoc
coccocbot-image
coccocbot-web
daumoa
dazoobot
deusu
duckduckbot
duckduckgo-favicons-bot
euripbot
exploratodo
facebookcatalog
facebookexternalhit
facebot
feedly
findxbot
gooblog
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mediapartners-google
microsoftpreview
mojeekbot
msnbot
msnbot-media
orangebot
pinterest
plukkie
qwantify
rambler
seznambot
sosospider
slurp
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
twitterbot
whatsapp
yacybot
yandex
yandexmobilebot
yepbot
yeti
yioopbot
yoozbot
youdaobot

Rule Path
Disallow

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://mondayitis.app/sitemap.xml
Back to top

Comments

  • ROBOTS.TXT
  • Updates and informantion can be found at:
  • https://www.ditig.com/publications/robots-txt-template
  • This document is licensed with a CC BY-NC-SA 4.0 license.
  • Last update: 2023-11-28
  • so.com chinese search engine
  • google.com landing page quality checks
  • google.com app resource fetcher
  • bing ads bot
  • apple.com search engine
  • baidu.com chinese search engine
  • bing.com international search engine
  • bublup.com suggestion/search engine
  • commoncrawl.org open repository of web crawl data
  • cliqz.com german in-product search engine
  • coccoc.com vietnamese search engine
  • daum.net korean search engine
  • dazoo.fr french search engine
  • deusu.de german search engine
  • duckduckgo.com international privacy search engine
  • eurip.com european search engine
  • exploratodo.com latin search engine
  • facebook.com social network
  • feedly.com feed fetcher
  • findx.com european search engine
  • goo.ne.jp japanese search engine
  • google.com international search engine
  • so.com chinese search engine
  • goo.ne.jp japanese search engine
  • istella.it italian search engine
  • jike.com / chinaso.com chinese search engine
  • lycos.com & hotbot.com international search engine
  • mail.ru russian search engine
  • google.com adsense bot
  • Preview bot for Microsoft products
  • mojeek.com search engine
  • bing.com international search engine
  • orange.com international search engine
  • pinterest.com social networtk
  • botje.nl dutch search engine
  • qwant.com french search engine
  • rambler.ru russian search engine
  • seznam.cz czech search engine
  • soso.com chinese search engine
  • yahoo.com international search engine
  • sogou.com chinese search engine
  • twitter.com social media bot
  • whatsapp.com preview bot
  • yacy.net p2p search software
  • yandex.com russian search engine
  • yep.com search engine
  • search.naver.com south korean search engine
  • yioop.com international search engine
  • yooz.ir iranian search engine
  • youdao.com chinese search engine
  • crawling rule(s) for above bots
  • disallow all other bots
Back to top

Warnings

  • 3 invalid lines.
Back to top