midnightspoiler.com
robots.txt

Robots Exclusion Standard data for midnightspoiler.com

Resource Scan

Scan Details

Site Domain midnightspoiler.com
Base Domain midnightspoiler.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-08T05:11:04+00:00
Next Scan 2026-02-06T05:11:04+00:00

Last Successful Scan

Scanned2025-07-10T10:07:57+00:00
URL https://midnightspoiler.com/robots.txt
Domain IPs 27.0.236.139
Response IP 27.0.236.139
Found Yes
Hash 0c3d44aebb32d151b7c9744b289b0c65bd32ccbd089948f2818c6ad30030fac2
SimHash 6581d8644ba0

Groups

*

Rule Path
Disallow /guestbook
Disallow /m/guestbook
Disallow /manage
Disallow /owner
Disallow /admin
Disallow /search
Disallow /m/search

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20