sup.org
robots.txt

Robots Exclusion Standard data for sup.org

Resource Scan

Scan Details

Site Domain sup.org
Base Domain sup.org
Scan Status Ok
Last Scan2025-08-05T01:13:59+00:00
Next Scan 2025-09-04T01:13:59+00:00

Last Scan

Scanned2025-08-05T01:13:59+00:00
URL https://sup.org/robots.txt
Redirect https://www.sup.org/robots.txt
Redirect Domain www.sup.org
Redirect Base sup.org
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash e7cebb16febdc537ab74560bad936e7d1c8a032e95df58fde61396673aaf334a
SimHash 6918c272ce93

Groups

*

Rule Path
Allow /
Disallow /api/
Disallow /search

Other Records

Field Value
crawl-delay 30