Ask HN: Code Llama 70B on a dedicated server

The author expresses a desire to rent a server with 128 GB of RAM for their web projects. The primary purpose of this server would be to launch CodeLlama 70B models. The author also questions the feasibility of this task without the use of video memory.

Key takeaways

The individual is looking to rent a server with 128 GB of RAM.
The server is intended for web projects.
The primary use of the server will be for launching CodeLlama 70B models.
The individual is questioning if this is possible without video memory.

Ask HN: Code Llama 70B on a dedicated server

Key takeaways

Discussion (0)