Log In Sign Up

inspirationwebworks.com
robots.txt

Robots Exclusion Standard data for inspirationwebworks.com

Resource Scan

Scan Details

Site Domain inspirationwebworks.com
Base Domain inspirationwebworks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-06T08:58:32+00:00
Next Scan 2025-02-04T08:58:32+00:00

Last Successful Scan

Scanned2024-06-17T08:57:16+00:00
URL https://inspirationwebworks.com/robots.txt
Domain IPs 144.202.48.223
Response IP 144.202.48.223
Found Yes
Hash 33e598619c6e55c1e0e0bf694803c7c728a2486f45511ddb6ee2696312577d6c
SimHash 521663626e82

Groups

ahrefsbot

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

baiduspider
baiduspider-video
baiduspider-image
baiduspider/2.0

Rule Path
Disallow /

deusu

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

jooble-bot

Rule Path
Disallow /
Disallow /

megaindex

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sogou

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /
Back to top

Comments

  • Baiduspider
Back to top

Warnings

  • `linkdexbot` is not a known field.
Back to top