Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
MacsHeadroom
on April 17, 2024
|
parent
|
context
|
favorite
| on:
Mixtral 8x22B
Four V100s will do. They're about $1k each on ebay.
astrodust
on April 17, 2024
[–]
$1500 each, plus the server they go in, plus plus plus plus.
MacsHeadroom
on April 17, 2024
|
parent
[–]
Sure, but it's still a lot less than 8 h100s.
~$8k for an LLM server with 128GB of VRAM vs like $250k+ for 8 H100s.
astrodust
on April 18, 2024
|
root
|
parent
[–]
$8K sounds like a lot more than "free".
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search:
