so-wiki.com
robots.txt

Robots Exclusion Standard data for so-wiki.com

Resource Scan

Scan Details

Site Domain so-wiki.com
Base Domain so-wiki.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-10-29T21:13:04+00:00
Next Scan 2024-11-05T21:13:04+00:00

Last Successful Scan

Scanned2024-10-21T21:11:50+00:00
URL https://so-wiki.com/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:5:da0f, 2a00:15f8:a000:5:1:12:5:da0f, 2a00:15f8:a000:5:1:13:5:da0f, 2a00:15f8:a000:5:1:14:5:da0f, 90.156.201.27, 90.156.201.52, 90.156.201.70, 90.156.201.97
Response IP 90.156.201.52
Found Yes
Hash 8d4a2681d5994a4d2ac67303b28e68087cd5d9bf0b95982901ae8fc7c1d5c390
SimHash 480898e0c7b9

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap http://so-wiki.com/sitemap_index_1.xml
sitemap http://so-wiki.com/sitemap_index_2.xml
sitemap http://so-wiki.com/sitemap_index_3.xml
sitemap http://so-wiki.com/sitemap_index_4.xml
sitemap http://so-wiki.com/sitemap_index_5.xml
sitemap http://so-wiki.com/sitemap_index_6.xml
sitemap http://so-wiki.com/sitemap_index_7.xml
sitemap http://so-wiki.com/sitemap_index_8.xml