segullah.org
robots.txt

Robots Exclusion Standard data for segullah.org

Resource Scan

Scan Details

Site Domain segullah.org
Base Domain segullah.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-09T20:36:16+00:00
Next Scan 2025-11-07T20:36:16+00:00

Last Successful Scan

Scanned2024-06-23T19:45:20+00:00
URL https://segullah.org/robots.txt
Domain IPs 35.215.107.200
Response IP 35.215.107.200
Found Yes
Hash c336bf1bfe7463b4cb2c0bd69fbe5be0c5a96d854dc62c17da197c843285f3a3
SimHash 6796b05767a4

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1