Log In Sign Up

168acg.com
robots.txt

Robots Exclusion Standard data for 168acg.com

Resource Scan

Scan Details

Site Domain 168acg.com
Base Domain 168acg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-09T14:13:07+00:00
Next Scan 2024-11-07T14:13:07+00:00

Last Successful Scan

Scanned2023-12-21T13:40:38+00:00
URL http://168acg.com/robots.txt
Redirect http://www.168acg.com/robots.txt
Redirect Domain www.168acg.com
Redirect Base 168acg.com
Domain IPs 103.148.151.145
Redirect IPs 103.148.151.145
Response IP 103.148.151.145
Found Yes
Hash b8ed4452df8185a589d4a4da4f86b0c116b9d0e62dc382c6fbc499fd41cffe02
SimHash 51564354e5e3

Groups

*

Rule Path
Disallow /addons/
Disallow /js/
Disallow /lib/
Disallow /public/
Disallow /runtime/
Disallow /thinkphp/
Disallow /player/
Disallow /tpl/
Disallow /index.php?s=%2Fhome%2Fplaylog*
Disallow /index.php?s=home-playlog*
Disallow /index.php/home/playlog*
Disallow /index.php?s=%2Fhome%2Fajax*
Disallow /index.php?s=home-ajax*
Disallow /index.php/home/ajax*
Disallow /index.php?s=%2Fhome-verify*
Disallow /index.php/home/verify*
Disallow /index.php?s=home-verify*
Disallow /index.php?s=%2Fhome%2Fhits*
Disallow /index.php?s=home-hits*
Disallow /index.php/home/hits*

intelx.io_bot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

superbot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

panscient

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

letsearchbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ds-robot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

konturbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

bsbot

Rule Path
Disallow /

bitsightbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

coccocbot-image

Rule Path
Disallow /

internetmeasurement

Rule Path
Disallow /

trendictionbot0.5.0

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

netestate

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

knowledge

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

linespider

Rule Path
Disallow /

crawler

Rule Path
Disallow /

simplecrawler

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

neevabot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

facebot

Rule Path
Disallow /

trendictionbot0

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

hubspot

Rule Path
Disallow /

opensiteexplorer

Rule Path
Disallow /

leiki

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top