stdlibrary.com
robots.txt
Robots Exclusion Standard data for stdlibrary.com
Resource Scan
Scan Details
| Site Domain | stdlibrary.com |
| Base Domain | stdlibrary.com |
| Scan Status | Ok |
| Last Scan | 2025-05-21T03:07:33+00:00 |
| Next Scan | 2025-05-28T03:07:33+00:00 |
Last Scan
| Scanned | 2025-05-21T03:07:33+00:00 |
| URL | https://www.stdlibrary.com/robots.txt |
| Domain IPs | 103.45.162.168 |
| Response IP | 103.45.162.168 |
| Found | Yes |
| Hash | 2de1388c86125076242ad6c2512c8680c957ab2133711735e5555886c79dd746 |
| SimHash | 870a2cc1c75a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /a* |
| Disallow | /b* |
| Disallow | /c* |
| Disallow | /d* |
| Disallow | /e* |
| Disallow | /f* |
| Disallow | /g* |
| Disallow | /h* |
| Disallow | /i* |
| Disallow | /j* |
| Disallow | /k* |
| Disallow | /l* |
| Disallow | /m* |
| Disallow | /n* |
| Disallow | /o* |
| Disallow | /p* |
| Disallow | /q* |
| Disallow | /r* |
| Disallow | /s* |
| Disallow | /t* |
| Disallow | /u* |
| Disallow | /v* |
| Disallow | /w* |
| Disallow | /x* |
| Disallow | /y* |
| Disallow | /z* |
| Disallow | /1* |
| Disallow | /2* |
| Disallow | /3* |
| Disallow | /4* |
| Disallow | /5* |
| Disallow | /6* |
| Disallow | /7* |
| Disallow | /8* |
| Disallow | /9* |
| Disallow | /0* |
| Disallow | /a*.html |
| Disallow | /b*.html |
| Disallow | /c*.html |
| Disallow | /d*.html |
| Disallow | /e*.html |
| Disallow | /f*.html |
| Disallow | /g*.html |
| Disallow | /h*.html |
| Disallow | /i*.html |
| Disallow | /j*.html |
| Disallow | /k*.html |
| Disallow | /l*.html |
| Disallow | /m*.html |
| Disallow | /n*.html |
| Disallow | /o*.html |
| Disallow | /p*.html |
| Disallow | /q*.html |
| Disallow | /r*.html |
| Disallow | /s*.html |
| Disallow | /t*.html |
| Disallow | /u*.html |
| Disallow | /v*.html |
| Disallow | /w*.html |
| Disallow | /x*.html |
| Disallow | /y*.html |
| Disallow | /z*.html |
| Disallow | /1*.html |
| Disallow | /2*.html |
| Disallow | /3*.html |
| Disallow | /4*.html |
| Disallow | /5*.html |
| Disallow | /6*.html |
| Disallow | /7*.html |
| Disallow | /8*.html |
| Disallow | /9*.html |
| Disallow | /0*.html |
| Allow | /p-*.html |
| Allow | /index.html |
| Allow | /g-*.html |
| Allow | /gl.html |
| Allow | /gl-*.html |
| Allow | /group.html |
| Allow | /info.html |
| Allow | /info-*.html |
| Allow | /i-*.html |
| Allow | /c.html |
| Allow | /c-*.html |
| Allow | /list.html |
| Allow | /free.html |
| Allow | /free-*.html |
| Allow | /d-*.html |
| Allow | /t-*.html |
| Allow | /task.html |
| Allow | /task-*.html |
| Allow | /n-*.html |
| Allow | /news.html |
| Allow | /news-*.html |
| Allow | /sitemap/*.xml |
| Allow | /sitemap.html |
| Allow | /sitemap-*.html |
| Allow | /order.html |
| Allow | /order-*.html |
| Allow | /tag-*.html |
| Allow | /tag.html |
| Allow | /tag/ |
| Allow | /tag/*.html |
| Allow | /tag/*.html? |
| Allow | /label-*.html |
| Allow | /label.html |
| Allow | /label/ |
| Allow | /label/*.html |
| Allow | /label/*.html? |
| Allow | /article/ |
| Allow | /article/*.html |
| Allow | /article/*.html? |
| Allow | /doc/ |
| Allow | /doc/*.html |
| Allow | /doc/*.html? |
| Allow | /content/ |
| Allow | /content/*.html |
| Allow | /content/*.html? |
| Allow | /paper/ |
| Allow | /paper/*.html |
| Allow | /paper/*.html? |
| Allow | /bggroup/*.html |
| Allow | /bggroupdown/*.html |
| Allow | /bggrouplist.html |
| Allow | /bggrouplist-*.html |
| Allow | /bggroup.html |
| Allow | /bookmap.html |
| Allow | /baogaolist-*.html |
| Allow | /baogaolist.html |
| Allow | /baogaofree.html |
| Allow | /baogaofree-*.html |
| Allow | /baogaoorder.html |
| Allow | /baogaoorder/.html |
| Allow | /zhuanti/*.html |
| Allow | /zhuantidown/*.html |
| Allow | /zhuantilist.html |
| Allow | /zhuantilist-*.html |
| Allow | /zhuantis.html |
| Allow | /bookmap.html |
| Allow | /booklist-*.html |
| Allow | /booklist.html |
| Allow | /bookfree.html |
| Allow | /bookfree-*.html |
| Allow | /docorder.html |
| Allow | /docorder/.html |
| Allow | /tasklist.html |
| Allow | /tasklist-*.html |
| Allow | /task/*.html |
| Allow | /infos.html |
| Allow | /info-*.html |
| Allow | /info/*.html |
| Allow | /newslist.html |
| Allow | /newslist-*.html |
| Allow | /news/*.html |
| Allow | /ucenter.html |
| Allow | /userlist.html |
| Allow | /userlist-*.html |
| Allow | /user/*.html |
| Allow | /user/*.html? |
| Allow | /sitemap.html |
| Allow | /sitemap-*.html |
| Allow | /order.html |
| Allow | /order-*.html |
| Allow | /tag-*.html |
| Allow | /bgtags.html |
| Allow | /bgtags/ |
| Allow | /bgtags/*.html |
| Allow | /bgtag/*.html |
| Allow | /bgtag/*.html? |
| Allow | /marks.html |
| Allow | /marks/ |
| Allow | /marks/*.html |
| Allow | /mark/*.html |
| Allow | /mark/*.html? |
| Allow | /baogao/ |
| Allow | /baogao/*.html |
| Allow | /baogao/*.html? |
| Allow | /bgdown/*.html |
| Allow | /bgdown/*.html? |
| Disallow | /FlexPaper/ |
| Disallow | /App_Data/ |
| Disallow | /Logs/ |
| Disallow | /MessageManage/ |
| Disallow | /UserControl/ |
| Disallow | /UserManage/ |
| Disallow | /View.aspx? |
| Disallow | /List.aspx? |
| Disallow | /user.aspx? |
| Disallow | /UserBase.aspx? |
| Disallow | /NewsView.aspx? |
| Disallow | /CategoryList.aspx? |
| Disallow | /Group.aspx? |
| Disallow | /GroupDetail.aspx? |
| Disallow | /GroupList.aspx? |
| Disallow | /UserCenter.aspx? |
| Disallow | /UserList.aspx? |
| Disallow | /UserGroup.aspx? |
| Disallow | /reg.aspx |
| Disallow | /login.aspx |
| Disallow | /friend.aspx |
| Disallow | /search.html?q=* |
| Disallow | /u-*.html?t=* |
| Disallow | /search.html? |
| Disallow | /reg.aspx |
| Disallow | /login.aspx |
| Disallow | /friend.aspx |
| Disallow | /Header.aspx |
| Disallow | /Header_single.aspx |
| Disallow | /Header_v1.aspx |
| Disallow | /Header_badou.aspx |
| Disallow | /Header_chutou.aspx |
| Disallow | /Header.aspx? |
| Disallow | /Header_single.aspx? |
| Disallow | /Header_v1.aspx? |
| Disallow | /Header_badou.aspx? |
| Disallow | /Header_chutou.aspx? |
| Disallow | /search.html?q=* |
| Disallow | /u-*.html?t=* |
| Disallow | /search.html? |
| Disallow | /search.aspx? |
| Disallow | /BookRead.aspx? |
Warnings
- 2 invalid lines.
Comments