aidotu.com
robots.txt

Robots Exclusion Standard data for aidotu.com

Resource Scan

Scan Details

Site Domain aidotu.com
Base Domain aidotu.com
Scan Status Ok
Last Scan2024-09-05T02:10:52+00:00
Next Scan 2024-10-05T02:10:52+00:00

Last Scan

Scanned2024-09-05T02:10:52+00:00
URL http://aidotu.com/robots.txt
Redirect https://aidotu.com/robots.txt
Domain IPs 101.37.81.144
Response IP 101.37.81.144
Found Yes
Hash 9c61b78c6f063208d2b4201707e0d3dd51b7c8db48404e9a3c337886c9ef2b97
SimHash 54269003f19a

Groups

dataforseobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

applebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

sm-g900p

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

feeddemon

Rule Path
Disallow /

indy library

Rule Path
Disallow /

alexa toolbar

Rule Path
Disallow /

asktbfxtv

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

crawldaddy

Rule Path
Disallow /

coolpadwebkit

Rule Path
Disallow /

universalfeedparser

Rule Path
Disallow /

apachebench

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

lightdeckreports bot

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

*

Rule Path
Disallow /copyright.html
Disallow /yinsi.html
Disallow /search/*-*-*-*.html
Disallow /muban/*-*-*-*.html
Disallow /package/*-*-*-*.html

Other Records

Field Value
sitemap /sitemap.xml