shortique.com
robots.txt

Robots Exclusion Standard data for shortique.com

Resource Scan

Scan Details

Site Domain shortique.com
Base Domain shortique.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-10-21T03:42:48+00:00
Next Scan 2025-10-28T03:42:48+00:00

Last Successful Scan

Scanned2025-09-20T03:35:45+00:00
URL http://shortique.com/robots.txt
Redirect http://www.shortique.com/robots.txt
Redirect Domain www.shortique.com
Redirect Base shortique.com
Domain IPs 107.174.183.240
Redirect IPs 107.174.183.240
Response IP 107.174.183.240
Found Yes
Hash 5b648ddec3c9f5b70cebfb727a95c01b9c46e634bb3f3bfda9bfc9d1e9c3b5a0
SimHash 0a0c2873ee9a

Groups

*

Rule Path
Disallow /admin/
Disallow /wp-admin/
Disallow /config/
Disallow /backup/
Disallow /data/
Disallow /tmp/
Disallow /private/
Disallow /*.js
Disallow /*.css
Disallow /api/
Disallow /*?*
Allow /*?s=*
Allow /*?page=*

baiduspider

Rule Path
Allow /play/
Disallow /user/

Other Records

Field Value
crawl-delay 1

sogou

Product Comment
sogou Ëѹ·
Rule Path
Allow /play/
Disallow /user/

googlebot

Rule Path
Disallow /

yunspider

Product Comment
yunspider ÉñÂíËÑË÷
Rule Path
Disallow /

yisouspider

Product Comment
yisouspider °¢ÀïÆìÏÂÉñÂíËÑË÷ÅÀ³æ
Rule Path
Disallow /

bytespider

Product Comment
bytespider ×Ö½ÚÌø¶¯ÆìÏÂÅÀ³æ
Rule Path
Disallow /

evilbot

Product Comment
evilbot Õë¶ÔÌØ¶¨¶ñÒâÅÀ³æ
Rule Path
Disallow /

duckduckbot

Product Comment
duckduckbot DuckDuckGoËÑË÷ÒýÇæ
Rule Path
Disallow /

applebot

Product Comment
applebot Æ»¹û¹«Ë¾¹Ù·½ÅÀ³æ
Rule Path
Disallow /

twitterbot

Product Comment
twitterbot ÍÆÌØ¹Ù·½ÅÀ³æ
Rule Path
Disallow /

facebookexternalhit

Product Comment
facebookexternalhit Meta¹Ù·½ÅÀ³æÕýÈ·Ãû³Æ
Rule Path
Disallow /

ahrefsbot

Product Comment
ahrefsbot AhrefsSEO¹¤¾ßÅÀ³æ
Rule Path
Disallow /

mj12bot

Product Comment
mj12bot MajesticSEOÅÀ³æ
Rule Path
Disallow /

semrushbot

Product Comment
semrushbot SEMRush¹¤¾ßÅÀ³æ
Rule Path
Disallow /

dotbot

Product Comment
dotbot ÄÚÈݾۺÏÅÀ³æ
Rule Path
Disallow /

yandexbot

Product Comment
yandexbot ¶íÂÞ˹YandexËÑË÷ÒýÇæ
Rule Path
Disallow /

zoominfobot

Product Comment
zoominfobot ÉÌÒµÊý¾Ý²É¼¯ÅÀ³æ
Rule Path
Disallow /

extlinksbot

Product Comment
extlinksbot ÍâÁ´¼ì²âÅÀ³æ
Rule Path
Disallow /

blexbot

Product Comment
blexbot WebÊý¾ÝÌáÈ¡ÅÀ³æ
Rule Path
Disallow /

ccbot

Product Comment
ccbot CommonCrawl»ù½ð»áÅÀ³æ
Rule Path
Disallow /

ia_archiver

Product Comment
ia_archiver AlexaÍøÕ¾ÅÅÃûÅÀ³æ
Rule Path
Disallow /

metauri

Product Comment
metauri ÔªÊý¾Ý²É¼¯ÅÀ³æ
Rule Path
Disallow /

nmap

Product Comment
nmap °²È«É¨Ã蹤¾ß
Rule Path
Disallow /

sqlmap

Product Comment
sqlmap SQL×¢È빤¾ß(ӦСд)
Rule Path
Disallow /

webzip

Product Comment
webzip ÍøÕ¾¾µÏñ¹¤¾ß
Rule Path
Disallow /

netcraftsurveyagent

Product Comment
netcraftsurveyagent ÍøÂ簲ȫµ÷²éÅÀ³æ
Rule Path
Disallow /
Disallow /.env
Disallow /phpinfo.php
Disallow /debug.php
Disallow /test.php
Disallow /vendor/
Disallow /phpmyadmin/

Other Records

Field Value
sitemap http://www.shortique.com/sitemap.xml

Comments

  • ===== È«¾Ö»ù´¡¹æÔò =====
  • ===== °Ù¶È/360/Ëѹ·×¨ÊôÓÅ»¯ =====
  • ===== À©Õ¹ÅÀ³æºÚÃûµ¥ =====
  • ===== °²È«·À»¤ =====

Warnings

  • 3 invalid lines.