does.pflbas.dc.gov
robots.txt

Robots Exclusion Standard data for does.pflbas.dc.gov

Resource Scan

Scan Details

Site Domain does.pflbas.dc.gov
Base Domain dc.gov
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-20T16:51:12+00:00
Next Scan 2025-05-19T16:51:12+00:00

Last Successful Scan

Scanned2025-01-13T16:09:04+00:00
URL https://does.pflbas.dc.gov/robots.txt
Domain IPs 104.18.36.77, 172.64.151.179, 2606:4700:4400::6812:244d, 2606:4700:4400::ac40:97b3
Response IP 172.64.151.179
Found Yes
Hash 4a1f50136dd58c7c46677e9b3f1bd3caaab7e2bec69520e296924d3e3b42646e
SimHash 88605a109711

Groups

*

Rule Path
Disallow /

twitterbot

Rule Path
Allow /vosnet/Default.aspx
Disallow /

facebookexternalhit/1.1

Rule Path
Allow /vosnet/Default.aspx
Disallow /

facebookcatalog/1.0

Rule Path
Allow /vosnet/Default.aspx
Disallow /

linkedinbot/1.0

Rule Path
Allow /vosnet/Default.aspx
Disallow /

googlebot

Rule Path
Allow /vosnet/Default.aspx