hydra20onion.com
robots.txt

Robots Exclusion Standard data for hydra20onion.com

Resource Scan

Scan Details

Site Domain hydra20onion.com
Base Domain hydra20onion.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-03T20:17:09+00:00
Next Scan 2024-07-02T20:17:09+00:00

Last Successful Scan

Scanned2023-11-13T20:06:48+00:00
URL https://hydra20onion.com/robots.txt
Domain IPs 104.21.63.89, 172.67.145.19, 2606:4700:3030::6815:3f59, 2606:4700:3037::ac43:9113
Response IP 172.67.145.19
Found Yes
Hash a6d428b1ba34def4a5303db800b306c8fec65a4703d1c792d357e8a6dcb9ed09
SimHash 61109cc0c1b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://hydra20onion.com/sitemap.xml

Warnings

  • `host` is not a known field.