Log In Sign Up

abouttender.com
robots.txt

Robots Exclusion Standard data for abouttender.com

Resource Scan

Scan Details

Site Domain abouttender.com
Base Domain abouttender.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2024-11-14T02:48:44+00:00
Next Scan 2024-12-14T02:48:44+00:00

Last Successful Scan

Scanned2024-10-16T02:28:44+00:00
URL http://abouttender.com/robots.txt
Domain IPs 182.48.43.154
Response IP 182.48.43.154
Found Yes
Hash d43037ee603466f80ce83b3c3d950f1bb513d00876f7a31718acd21e087eb928
SimHash 19956171e688

Groups

amazonbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

linguee

Rule Path
Disallow /

proximic

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

microadbot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

cincraw

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

quantcastbot

Rule Path
Disallow /

contxbot

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

bidswitchbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

integralads

Rule Path
Disallow /

jet-bot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /
Back to top