social.spooky.click
robots.txt

Robots Exclusion Standard data for social.spooky.click

Resource Scan

Scan Details

Site Domain social.spooky.click
Base Domain spooky.click
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-19T07:49:52+00:00
Next Scan 2024-11-17T07:49:52+00:00

Last Successful Scan

Scanned2023-05-04T01:58:35+00:00
URL https://social.spooky.click/robots.txt
Domain IPs 149.248.205.203, 2a09:8280:1::6:9e76
Response IP 149.248.205.203
Found Yes
Hash bfb456d590fa07e31990e8bdea94ff502f5aaf0ea8b6aa2101d21f4bc3de0d96
SimHash 7d36eb348919

Groups

*

Rule Path
Disallow /api/
Disallow /auth/
Disallow /oauth/
Disallow /check_your_email
Disallow /wait_for_approval
Disallow /account_disabled
Disallow /.well-known/
Disallow /fileserver/
Disallow /users/
Disallow /emoji/
Disallow /admin
Disallow /user
Disallow /settings/

Other Records

Field Value
crawl-delay 500

Comments

  • api stuff
  • auth/login stuff
  • well known stuff
  • files
  • s2s AP stuff
  • panels