blogistic.net
robots.txt

Robots Exclusion Standard data for blogistic.net

Resource Scan

Scan Details

Site Domain blogistic.net
Base Domain blogistic.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-18T23:23:43+00:00
Next Scan 2025-09-25T23:23:43+00:00

Last Successful Scan

Scanned2025-09-10T21:45:01+00:00
URL https://blogistic.net/robots.txt
Domain IPs 83.65.2.4
Response IP 83.65.2.4
Found Yes
Hash 2ba69ee9e62d6475c3a698722ef89256475f9e99f7fb6e1737f97f4f4995a90c
SimHash 103d73624ab3

Groups

*

Rule Path
Allow /

*

Rule Path
Allow /wp-admin/admin-ajax.php

*

Rule Path
Allow /css/
Allow /js/

*

Rule Path
Allow /amp/
Allow /amp%3D1/

badbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

wormgpt

Rule Path
Disallow /

autogpt

Rule Path
Disallow /

fraudgpt

Rule Path
Disallow /

chaosgpt

Rule Path
Disallow /

freedomgpt

Rule Path
Disallow /

chatgpt-dan

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

grum

Rule Path
Disallow /

bobax

Rule Path
Disallow /

pushdo

Rule Path
Disallow /

rustock

Rule Path
Disallow /

bagle

Rule Path
Disallow /

mega-d

Rule Path
Disallow /

maazben

Rule Path
Disallow /

xarvester

Rule Path
Disallow /

donbot

Rule Path
Disallow /

gheg

Rule Path
Disallow /

*

Rule Path
Disallow /private/
Disallow /temp/
Disallow /search

Other Records

Field Value
sitemap https://blogistic.net/sitemap.xml
sitemap https://blogistic.net/sitemap_index.xml
sitemap https://blogistic.net/sitemap-video.xml
sitemap https://blogistic.net/post-sitemap2.xml
sitemap https://blogistic.net/post-sitemap.xml
sitemap https://blogistic.net/category-sitemap.xml
sitemap https://blogistic.net/page-sitemap.xml