selector.site
robots.txt

Robots Exclusion Standard data for selector.site

Resource Scan

Scan Details

Site Domain selector.site
Base Domain selector.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-09T09:49:47+00:00
Next Scan 2026-03-09T09:49:47+00:00

Last Successful Scan

Scanned2022-11-24T07:26:54+00:00
URL https://selector.site/robots.txt
Response IP 104.21.40.205, 172.67.188.94
Found Yes
Hash fb23a2d5237707aaaa6c526a4988a8cf32eda2684f00c55e3cc17d81289f4fcb
SimHash 6900fe61ced3

Groups

*

Rule Path
Disallow /play
Disallow /cgi-bin/
Disallow /cgi-sys/
Disallow /frame
Disallow /administration
Allow /

Other Records

Field Value
sitemap https://selector.site/sitemap.xml

Warnings

  • `host` is not a known field.