본문 바로가기
조회 수 39 추천 수 0 댓글 0

단축키

Prev이전 문서

Next다음 문서

단축키

Prev이전 문서

Next다음 문서

NVIDIA가 호퍼 아키텍처 GPU와 HBM3e 메모리를 탑재한 H200, 그리고 HGX H200을 발표했습니다. 

 

메모리 대역폭은 4.8TB/s, 용량은 141GB로 H100보다 대역폭이 1.4배, 용량이 2배로 늘었습니다. 그래서 Llama2 70B는 1.9배, GPT-3 175B는 1.6배의 성능 향상이 있습니다. 

 

SC23—NVIDIA today announced it has supercharged the world’s leading AI computing platform with the introduction of the NVIDIA HGX™ H200. Based on NVIDIA Hopper™ architecture, the platform features the NVIDIA H200 Tensor Core GPU with advanced memory to handle massive amounts of data for generative AI and high performance computing workloads.

The NVIDIA H200 is the first GPU to offer HBM3e — faster, larger memory to fuel the acceleration of generative AI and large language models, while advancing scientific computing for HPC workloads. With HBM3e, the NVIDIA H200 delivers 141GB of memory at 4.8 terabytes per second, nearly double the capacity and 2.4x more bandwidth compared with its predecessor, the NVIDIA A100.

H200-powered systems from the world’s leading server manufacturers and cloud service providers are expected to begin shipping in the second quarter of 2024.

“To create intelligence with generative AI and HPC applications, vast amounts of data must be efficiently processed at high speed using large, fast GPU memory,” said Ian Buck, vice president of hyperscale and HPC at NVIDIA. “With NVIDIA H200, the industry’s leading end-to-end AI supercomputing platform just got faster to solve some of the world’s most important challenges.”

Perpetual Innovation, Perpetual Performance Leaps
The NVIDIA Hopper architecture delivers an unprecedented performance leap over its predecessor and continues to raise the bar through ongoing software enhancements with H100, including the recent release of powerful open-source libraries like NVIDIA TensorRT™-LLM.

The introduction of H200 will lead to further performance leaps, including nearly doubling inference speed on Llama 2, a 70 billion-parameter LLM, compared to the H100. Additional performance leadership and improvements with H200 are expected with future software updates.

NVIDIA H200 Form Factors
NVIDIA H200 will be available in NVIDIA HGX H200 server boards with four- and eight-way configurations, which are compatible with both the hardware and software of HGX H100 systems. It is also available in the NVIDIA GH200 Grace Hopper™ Superchip with HBM3e, announced in August.

With these options, H200 can be deployed in every type of data center, including on premises, cloud, hybrid-cloud and edge. NVIDIA’s global ecosystem of partner server makers — including ASRock RackASUS, Dell Technologies, Eviden, GIGABYTE, Hewlett Packard Enterprise, Ingrasys, Lenovo, QCT, Supermicro, Wistron and Wiwynn — can update their existing systems with an H200.

Amazon Web Services, Google Cloud, Microsoft Azure and Oracle Cloud Infrastructure will be among the first cloud service providers to deploy H200-based instances starting next year, in addition to CoreWeaveLambda and Vultr.

Powered by NVIDIA NVLink™ and NVSwitch™ high-speed interconnects, HGX H200 provides the highest performance on various application workloads, including LLM training and inference for the largest models beyond 175 billion parameters.

An eight-way HGX H200 provides over 32 petaflops of FP8 deep learning compute and 1.1TB of aggregate high-bandwidth memory for the highest performance in generative AI and HPC applications.

When paired with NVIDIA Grace™ CPUs with an ultra-fast NVLink-C2C interconnect, the H200 creates the GH200 Grace Hopper Superchip with HBM3e — an integrated module designed to serve giant-scale HPC and AI applications.

Accelerate AI With NVIDIA Full-Stack Software
NVIDIA’s accelerated computing platform is supported by powerful software tools that enable developers and enterprises to build and accelerate production-ready applications from AI to HPC. This includes the NVIDIA AI Enterprise suite of software for workloads such as speech, recommender systems and hyperscale inference.

Availability
The NVIDIA H200 will be available from global system manufacturers and cloud service providers starting in the second quarter of 2024.

Watch Buck’s SC23 special address on Nov. 13 at 6 a.m. PT to learn more about the NVIDIA H200 Tensor Core GPU.

 

01_o.jpg

 

https://nvidianews.nvidia.com/news/nvidia-supercharges-hopper-the-worlds-leading-ai-computing-platform




List of Articles
번호 분류 제목 글쓴이 조회 수 날짜
공지 덕질 공통 이용규칙 및 안내 (업데이트중+ 2024-04-13) 😀컴덕824 3913 2024.04.14
공지 1000P를 모으면 다이소 상품권 1000원을 신청할 수 있습니다. file Private 4975 2024.02.14
5309 질문 램 16기가짜리 2개 사려는데 1 😀컴덕1321 25 2024.06.01
5308 질문 100w 충전기로 문제 안생길까요?? 😀컴덕1842 7 2024.06.01
5307 해외직구 합산과세 질문드립니다. 1 😀컴덕554 15 2024.06.01
5306 일반 루머)AMD가 라이젠 9000시리즈에서 TDP를 다시 내린다네? file 😀컴덕579 18 2024.06.01
5305 일반 윈도우11 크롬 쓰시는분들 속보 file 😀컴덕199 16 2024.06.01
5304 일반 마이크로소프트 엣지, 무료 VPN 제공 file 😀컴덕866 8 2024.06.01
5303 일반 AMD, 인텔 시원하게 앞질렀다! 라이젠5 5600 file 😀컴덕566 22 2024.05.20
5302 일반 PC MS, 소형언어모델 '파이-3 미니' 출시 😀컴덕102 12 2024.05.20
5301 일반 그래픽카드 가성비 비교표 5월 ( 반격의 AMD !!) 영상 file 😀컴덕433 13 2024.05.20
5300 일반 구글, 크로미움에서 서드파티 쿠키 퇴출 2025년으로 또 다시 연기 😀컴덕171 16 2024.05.20
5299 일반 일론 머스크의 AI 기업 'xAI' 8조원 규모 투자 유치 😀컴덕275 12 2024.05.20
5298 일반 PC [MSI 메인보드 사용기]x670e 토마호크 와이파이 file 😀컴덕034 17 2024.05.20
5297 일반 소울시커 Soul Seeker님의 인텔 불량 테스트 2 (14900K) / 인텔의 표리부동, 사실상 13,14세대 손절? 아 욕... file 😀컴덕035 26 2024.05.20
5296 운영체제 PC 구글, 검색시장 점유율 4월 기준 전년 동월 대비 약 2% 하락 😀컴덕024 7 2024.05.20
5295 일반 MSI.인텔 13/14세대 안정 바이오스 업데이트 file 😀컴덕579 14 2024.05.20
5294 일반 라이젠 7800X3D vs 라이젠 7600!! 이길수 있을까 7600이?ㅋㅋㅋ file 😀컴덕438 17 2024.05.20
5293 일반 HBM 메모리 성장률, 2024년 200% ... 2025년 400% 전망 😀컴덕424 13 2024.05.20
5292 운영체제 MS, 윈도우 10에서 윈도우 11 23H2 버전으로 바로 업그레이드 지원 😀컴덕172 11 2024.05.20
5291 일반 대만 지진 여파로 올 2분기 DRAM 가격 13~18%, 낸드 가격 15~20% 상승 전망 😀컴덕762 12 2024.05.20
5290 일반 구글, 연례개발자회의 '구글 I/O' 통해 '제미나이 1.5' 대규모 업데이트 발표 ... 검색... file 😀컴덕887 8 2024.05.20
목록
Board Pagination Prev 1 2 3 4 5 6 7 8 9 10 ... 266 Next
/ 266