Log In Sign Up

2.imimg.com
robots.txt

Robots Exclusion Standard data for 2.imimg.com

Resource Scan

Scan Details

Site Domain 2.imimg.com
Base Domain imimg.com
Scan Status Ok
Last Scan2024-05-17T09:36:45+00:00
Next Scan 2024-06-16T09:36:45+00:00

Last Scan

Scanned2024-05-17T09:36:45+00:00
URL https://2.imimg.com/robots.txt
Domain IPs 108.157.254.123, 108.157.254.7, 108.157.254.82, 108.157.254.87, 2600:9000:2753:1200:6:9fc7:6f80:93a1, 2600:9000:2753:1c00:6:9fc7:6f80:93a1, 2600:9000:2753:2000:6:9fc7:6f80:93a1, 2600:9000:2753:200:6:9fc7:6f80:93a1, 2600:9000:2753:4000:6:9fc7:6f80:93a1, 2600:9000:2753:8e00:6:9fc7:6f80:93a1, 2600:9000:2753:c600:6:9fc7:6f80:93a1, 2600:9000:2753:fa00:6:9fc7:6f80:93a1
Response IP 108.157.254.82
Found Yes
Hash e61c092d5ac6242e0f13ea71ff3ecf913c30dd03ab312a50db00a6891162c323
SimHash 511cd330c51b

Groups

gptbot

Product Comment
gptbot OpenAI
Rule Path
Disallow /

chatgpt

Product Comment
chatgpt OpenAI
Rule Path
Disallow /

chatgpt-user

Product Comment
chatgpt-user OpenAI
Rule Path
Disallow /

openai

Product Comment
openai OpenAI
Rule Path
Disallow /

google-extended

Product Comment
google-extended Google Bard
Rule Path
Disallow /

adidxbot

Product Comment
adidxbot AdIdxbot
Rule Path
Disallow /

facebookbot

Product Comment
facebookbot Facebook bot
Rule Path
Disallow /

facebot

Product Comment
facebot Facebook bot
Rule Path
Disallow /

twitterbot

Product Comment
twitterbot Twitter bot
Rule Path
Disallow /

ccbot

Product Comment
ccbot Commoncrawl
Rule Path
Disallow /

claudebot

Product Comment
claudebot Claude Bot
Rule Path
Disallow /

criteobot/0.1

Product Comment
criteobot/0.1 Criteo Bot
Rule Path
Disallow /

alexabot

Product Comment
alexabot Alexabot
Rule Path
Disallow /

ia_archiver

Product Comment
ia_archiver Internet Archive
Rule Path
Disallow /

alexa site audit

Product Comment
alexa site audit Alexa audit crawler
Rule Path
Disallow /

anthropic-ai

Product Comment
anthropic-ai Anthropic
Rule Path
Disallow /

bytespider

Product Comment
bytespider ByteDance
Rule Path
Disallow /

omgili

Product Comment
omgili Webz.io
Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

dcrawl

Rule Path
Disallow /

nutch

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3.0

Rule Path
Disallow /

metainspector

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

slurp

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

feedonomics

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

eyemonit uptime bot

Rule Path
Disallow /

ahrefssiteaudit

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

feedburner

Rule Path
Disallow /

exabot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

ias crawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

pingdom.com_bot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

expo9

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

www.admantx.com/service-fetcher.html

Rule Path
Disallow /

mozilla/5.0 muhstik-scan

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Back to top

Comments

  • Disallowing AI/ML Bots
  • Disallowing Other Bots
Back to top

Warnings

  • 2 invalid lines.
Back to top