auctions.speedstowingauction.com
robots.txt

Robots Exclusion Standard data for auctions.speedstowingauction.com

Resource Scan

Scan Details

Site Domain auctions.speedstowingauction.com
Base Domain speedstowingauction.com
Scan Status Ok
Last Scan2025-03-11T10:31:59+00:00
Next Scan 2025-04-10T10:31:59+00:00

Last Scan

Scanned2025-03-11T10:31:59+00:00
URL https://auctions.speedstowingauction.com/robots.txt
Domain IPs 54.230.112.112, 54.230.112.114, 54.230.112.123, 54.230.112.60
Response IP 108.156.22.80
Found Yes
Hash a41e75caf8e7626f1cf6e3a4cc1b0d853c79a786282c6ab2e26881cf6095b3bb
SimHash a1259e83e3f9

Groups

*

Rule Path
Disallow /itembid.aspx
Disallow /itembuy.aspx
Disallow /WebResource.axd
Disallow /account/
Disallow /bidlive/bidapp.aspx
Disallow /search.aspx
Disallow /auctioneercontact.aspx
Disallow /login.aspx
Disallow /register.aspx
Disallow /auctionprint.aspx
Disallow /auctionmap.aspx
Disallow /touch.ashx
Disallow /signup.aspx
Disallow /policy.aspx
Disallow /auctioninfo.aspx
Disallow /signupprompt.aspx
Disallow /livebid.aspx

addthis.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

facebookexternalhit

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

meta-externalagent

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1