directorybug.com
robots.txt

Robots Exclusion Standard data for directorybug.com

Resource Scan

Scan Details

Site Domain directorybug.com
Base Domain directorybug.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-30T07:13:30+00:00
Next Scan 2025-09-29T07:13:30+00:00

Last Successful Scan

Scanned2025-07-09T05:53:03+00:00
URL https://directorybug.com/robots.txt
Domain IPs 69.175.102.130
Response IP 69.175.102.130
Found Yes
Hash 6288dde2996947fa48d1dd7de610bc66852ec0e288a275a3f8b44c6883d5b7f2
SimHash 2938dcc0c3b2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60