hakin9.org
robots.txt

Robots Exclusion Standard data for hakin9.org

Resource Scan

Scan Details

Site Domain hakin9.org
Base Domain hakin9.org
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-09T14:38:39+00:00
Next Scan 2025-12-08T14:38:39+00:00

Last Successful Scan

Scanned2024-07-24T08:21:56+00:00
URL https://hakin9.org/robots.txt
Domain IPs 104.26.12.223, 104.26.13.223, 172.67.73.178, 2606:4700:20::681a:cdf, 2606:4700:20::681a:ddf, 2606:4700:20::ac43:49b2
Response IP 104.26.12.223
Found Yes
Hash 380f0d604e7349176b09b146677f355f7af6bc5ba25bab16c4bb899bb1ae4307
SimHash 5b69dc08c481

Groups

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /wp-admin/
Disallow *.pdf$
Disallow *.doc$
Disallow *.docx$
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /trackback/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /*blackhole
Disallow /?blackhole

*

Rule Path
Disallow /wp-content/uploads/vj-wp-import-export/

Other Records

Field Value
sitemap https://hakin9.org/sitemap_index.xml

Comments

  • WP Import Export Rule