expreview.com
robots.txt

Robots Exclusion Standard data for expreview.com

Resource Scan

Scan Details

Site Domain expreview.com
Base Domain expreview.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-11-06T18:47:20+00:00
Next Scan 2024-12-06T18:47:20+00:00

Last Successful Scan

Scanned2024-10-01T18:46:29+00:00
URL https://expreview.com/robots.txt
Domain IPs 46.3.113.71
Response IP 46.3.113.71
Found Yes
Hash 82d730e1465482dbb2016d8cf5cc179135ecae62ed87521b6585023538f11c24
SimHash 785a69c6698a

Groups

*

Rule Path
Disallow /api/
Disallow /data/
Disallow /source/
Disallow /install/
Disallow /template/
Disallow /config/
Disallow /uc_client/
Disallow /uc_server/
Disallow /static/
Disallow /admin.php
Disallow /search.php
Disallow /member.php
Disallow /api.php
Disallow /misc.php
Disallow /connect.php
Disallow /forum.php?mod=redirect*
Disallow /forum.php?mod=post*
Disallow /home.php?mod=spacecp*
Disallow /userapp.php?mod=app&*
Disallow /*?mod=misc*
Disallow /*?mod=attachment*
Disallow /*mobile%3Dyes*

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

researchscan

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Comments

  • robots.txt for Discuz! X3