Log In Sign Up

m.imimg.com
robots.txt

Robots Exclusion Standard data for m.imimg.com

Resource Scan

Scan Details

Site Domain m.imimg.com
Base Domain imimg.com
Scan Status Ok
Last Scan2024-05-20T14:53:48+00:00
Next Scan 2024-06-03T14:53:48+00:00

Last Scan

Scanned2024-05-20T14:53:48+00:00
URL https://m.imimg.com/robots.txt
Domain IPs 108.156.133.123, 108.156.133.46, 108.156.133.48, 108.156.133.86
Response IP 108.156.133.48
Found Yes
Hash 3b5b2e56293cfb18aa313d2b9e17a1a2ca0d276a80892f9ff2a651085ceddca6
SimHash 5158db31c572

Groups

*

Rule Path Comment
Disallow /pd/ For preview snippet generation WhatsApp bot does not honor robots.txt
Disallow /my/ -
Disallow /desktopredirect/ -
Disallow /isearch.php -
Disallow /recommendeditems.php -
Disallow /IMartEvents/ -
Disallow /vpv/ -
Disallow /cgi/ -
Disallow /app.php -
Disallow /sent/ -
Disallow /enq/ -
Disallow /company1/ -
Disallow /messages/ -
Disallow /search.php -
Disallow /detail/ -
Disallow /gallery.html -

gptbot

Product Comment
gptbot OpenAI
Rule Path
Disallow /

chatgpt

Product Comment
chatgpt OpenAI
Rule Path
Disallow /

chatgpt-user

Product Comment
chatgpt-user OpenAI
Rule Path
Disallow /

openai

Product Comment
openai OpenAI
Rule Path
Disallow /

google-extended

Product Comment
google-extended Google Bard
Rule Path
Disallow /

adidxbot

Product Comment
adidxbot AdIdxbot
Rule Path
Disallow /

facebookbot

Product Comment
facebookbot Facebook bot
Rule Path
Disallow /

facebot

Product Comment
facebot Facebook bot
Rule Path
Disallow /

twitterbot

Product Comment
twitterbot Twitter bot
Rule Path
Disallow /

ccbot

Product Comment
ccbot Commoncrawl
Rule Path
Disallow /

claudebot

Product Comment
claudebot Claude Bot
Rule Path
Disallow /

criteobot/0.1

Product Comment
criteobot/0.1 Criteo Bot
Rule Path
Disallow /

alexabot

Product Comment
alexabot Alexabot
Rule Path
Disallow /

ia_archiver

Product Comment
ia_archiver Internet Archive
Rule Path
Disallow /

alexa site audit

Product Comment
alexa site audit Alexa audit crawler
Rule Path
Disallow /

anthropic-ai

Product Comment
anthropic-ai Anthropic
Rule Path
Disallow /

bytespider

Product Comment
bytespider ByteDance
Rule Path
Disallow /

omgili

Product Comment
omgili Webz.io
Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

nutch

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

feedonomics

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

eyemonit uptime bot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

ias crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

pingdom.com_bot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dalvik

Rule Path
Disallow /

www.admantx.com/service-fetcher.html

Rule Path
Disallow /

mozilla/5.0 muhstik-scan

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mediapartners-google

Rule Path
Allow /
Back to top

Comments

  • Disallowing paths
  • Disallowing AI/ML Bots
  • Disallowing Other Bots
  • Allowing
Back to top

Warnings

  • 2 invalid lines.
Back to top