Launching & Running Large Language Models on a Single Dell Server Produces Outstanding Results

Cover Image

Launching and Running Large Language Models on a Single Dell Server Produces Outstanding Results is a fascinating whitepaper from Dell Technologies.

Download the whitepaper to see test results of one approach to developing and deploying Large Language Models (LLMs) on a single Dell PowerEdge server.

Highlights include:

  • How a single Dell PowerEdge XE9680 server has the capability to create and run language models similar in size and capabilities to ChatGPT.
  • Superior model throughput and performance on publicly available benchmarks when compared to one of the world’s most powerful supercomputers. 
  • The impact of language model throughput on the inference model loading library, model precision, batch size and available GPUs. 
  • And much more.

Your copy of Launching and Running Large Language Models on a Single Dell Server Produces Outstanding Results is available now from Dell Technologies and Intel®.

Vendor:
Dell Technologies and Intel®
Posted:
Aug 3, 2023
Published:
Aug 3, 2023
Format:
PDF
Type:
White Paper
Already a Bitpipe member? Log in here

Download this White Paper!