Log In Sign Up

thereaderwiki.com
robots.txt

Robots Exclusion Standard data for thereaderwiki.com

Resource Scan

Scan Details

Site Domain thereaderwiki.com
Base Domain thereaderwiki.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-10-29T10:17:56+00:00
Next Scan 2025-11-05T10:17:56+00:00

Last Successful Scan

Scanned2025-10-19T07:13:19+00:00
URL https://thereaderwiki.com/robots.txt
Domain IPs 104.21.58.52, 172.67.201.18, 2606:4700:3032::ac43:c912, 2606:4700:3036::6815:3a34
Response IP 172.67.201.18
Found Yes
Hash ad12f9b98a319a78313eb89ce8e0ac3707318c1cdedb9bac5bdf3b346816f3fc
SimHash 40281ab10611

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://thereaderwiki.com/xml/sitemap_zh_11.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_12.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_13.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_14.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_15.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_16.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_17.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_18.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_19.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_20.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_21.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_22.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_23.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_24.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_25.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_26.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_27.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_28.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_29.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_30.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_31.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_32.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_33.txt
sitemap https://thereaderwiki.com/xml/sitemap_zh_34.txt
Back to top