bid.landsboroughauctions.com
robots.txt

Robots Exclusion Standard data for bid.landsboroughauctions.com

Resource Scan

Scan Details

Site Domain bid.landsboroughauctions.com
Base Domain landsboroughauctions.com
Scan Status Ok
Last Scan3/11/2025, 3:54:37 PM
Next Scan 4/10/2025, 3:54:37 PM

Last Scan

Scanned3/11/2025, 3:54:37 PM
URL https://bid.landsboroughauctions.com/robots.txt
Domain IPs 18.154.206.107, 18.154.206.121, 18.154.206.7, 18.154.206.71
Response IP 18.165.122.15
Found Yes
Hash a41e75caf8e7626f1cf6e3a4cc1b0d853c79a786282c6ab2e26881cf6095b3bb
SimHash a1259e83e3f9

Groups

*

Rule Path
Disallow /itembid.aspx
Disallow /itembuy.aspx
Disallow /WebResource.axd
Disallow /account/
Disallow /bidlive/bidapp.aspx
Disallow /search.aspx
Disallow /auctioneercontact.aspx
Disallow /login.aspx
Disallow /register.aspx
Disallow /auctionprint.aspx
Disallow /auctionmap.aspx
Disallow /touch.ashx
Disallow /signup.aspx
Disallow /policy.aspx
Disallow /auctioninfo.aspx
Disallow /signupprompt.aspx
Disallow /livebid.aspx

addthis.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1