designtube.org
robots.txt

Robots Exclusion Standard data for designtube.org

Resource Scan

Scan Details

Site Domain designtube.org
Base Domain designtube.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-03-12T01:53:07+00:00
Next Scan 2025-06-10T01:53:07+00:00

Last Successful Scan

Scanned2022-11-17T02:58:45+00:00
URL https://designtube.org/robots.txt
Redirect https://www.designtube.org/robots.txt
Redirect Domain www.designtube.org
Redirect Base designtube.org
Response IP 104.21.17.81, 172.67.175.79
Found Yes
Hash eda524100aac9210b09e6a9c5e6bf453ec5b02d0f59bd15bd74ce4d4a0c90a16
SimHash 6c04b57a09b3

Groups

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /engine/
Disallow /files/
Disallow /file/
Disallow /download/
Disallow /newposts/
Disallow /addnews.html
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch*
Disallow /*?*
Disallow /disclaimer.html
Disallow /dmca.html
Disallow /privacy.html

Other Records

Field Value
sitemap http://www.designtube.org/sitemap.xml

Warnings

  • 2 invalid lines.