haversatewing.hibid.com
robots.txt

Robots Exclusion Standard data for haversatewing.hibid.com

Resource Scan

Scan Details

Site Domain haversatewing.hibid.com
Base Domain hibid.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-02T16:39:15+00:00
Next Scan 2026-04-02T16:39:15+00:00

Last Successful Scan

Scanned2025-05-14T20:57:17+00:00
URL https://haversatewing.hibid.com/robots.txt
Domain IPs 104.18.14.136, 104.18.15.136
Response IP 104.18.15.136
Found Yes
Hash 8140e6a46d4628b00b548cd232e227d15813165a8d21255aaff7d96765d2728e
SimHash 6f025a70c7fc

Groups

powermapper

Rule Path
Allow /

bingpreview
adidxbot
msnbot-media
bingbot
msnbot

Rule Path
Disallow /livecatalog/
Disallow /webcast/
Disallow /auctioneer/
Disallow /account/
Disallow /catalog/print/
Disallow /error/
Disallow /auctions/current/map/
Disallow /auctions/past/*?q=*
Disallow /auctions/past/*%26q%3D*
Disallow /hibiddemo/

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /livecatalog/
Disallow /webcast/
Disallow /auctioneer/
Disallow /account/
Disallow /catalog/print/
Disallow /error/
Disallow /auctions/current/map/
Disallow /auctions/past/*?q=*
Disallow /auctions/past/*%26q%3D*
Disallow /hibiddemo/

Other Records

Field Value
sitemap https://cdn.hibid.com/cdn/sitemaps/sitemap.xml