top of page
AI Solutions banner.png

HighPoint Gen5 AI Upgrade Solutions: AUTONOMOUS PCIE GEN5 SWITCHING FABRIC

Instant Gen5 AI Compute. Zero Platform Refresh.

Double your edge throughput to 57 GB/s Gen5 line rate—delivering 600W Blackwell compute on Gen4 and Gen5 platforms without a system overhaul or upgrade!

HighPoint Gen5 AI Upgrade Solutions empower systems integrators, OEM builders, and infrastructure architects to deploy next-generation accelerators, including 600W NVIDIA Blackwell PRO GPUs, and high-density NVMe storage directly onto existing Intel and AMD x86 platforms, avoiding the prohibitive capital expenditure, structural chassis constraints, and the operational disruption of a full server overhaul.

 

Modern AI workloads at the edge face severe slot limitations, insufficient onboard power, and thermal barriers that physically prevent housing 600W active-cooled accelerators inside compact 1U/2U chassis. HighPoint resolves these physical and architectural bottlenecks directly at the silicon and interconnect layers.

PCIe 5.0 Switch.png

Silicon-Level Sub-Fabric: Powered by an integrated 48-lane Broadcom PCIe Gen5 switch, the platform establishes a localized, autonomous downstream crossbar that routes high-throughput DMA transfers device-to-device at full line rate (up to 64 GB/s bi-directional)—completely bypassing the host CPU, system RAM, and motherboard bus. 

MCIO.png

Flexible Internal & External Interconnects: Internal Expansion: Direct-attach dual SFF-TA-1016 (MCIO 8i) ports interface natively with enterprise U.2/U.3/E3.S storage backplanes or MCIO-to-PCIe Gen5 Slot Bridge Links for seamless in-chassis lane and slot expansion.

图片1.avif

External Acceleration: Dedicated PCI-SIG CopprLink™ (CDFP x16) connectivity delivers 8x the bandwidth of legacy consumer OCuLink, driving external 1300W compute enclosures with zero-degradation signal integrity. 

图片1.png

Native NVIDIA GDS & GPUDirect P2P: Delivers the physical zero-copy hardware topology required for libcufile and CUDA P2P to stream model weights, checkpoint files, and intermediate tensors directly into GPU VRAM with sub-microsecond switch latency. 

图片2.png

Empirically Proven Parity: Delivers identical 57+ GB/s line-rate storage-to-GPU throughput across both legacy PCIe Gen4 and modern Gen5 platforms, doubling traditional Gen4 host bandwidth while slashing host CPU load  down to as low as 7.1%

Metric
Specification
Architectural Value
Physical Bandwidth
64 GB/s Bi-Directional
Full PCIe Gen5 x16 line-rate transmission
Switching Fabric
Broadcom 48-Lane Silicon
Autonomous crossbar routing; ~100–150 ns switch latency
I/O Routing Mode
Direct Hardware P2P DMA
Complete host CPU, system RAM, and host bus bypass
Cabled Interconnect
PCI-SIG CopprLink™ (CDFP x16)
8x the throughput of consumer OCuLink (Gen4 x4)
Compute Power Footprint
1300W Isolated Power
Sustains 600W workstation GPUs without server chassis overhauls

​Empirically Proven: Gen5 Performance on Gen4 Host Infrastructure

Standard host-routed architectures force storage-to-GPU data through the host CPU's PCIe root complex, triggering bus congestion and kernel context switches. HighPoint’s downstream switching fabric shifts the crossbar directly onto the expansion layer, delivering native PCIe Gen5 line-rate performance across both modern Gen5 and legacy Gen4 x86 servers. 

GDS Benchmark Parity

Tested using the official NVIDIA gdsio utility across 16x Enterprise NVMe SSDs and an Missing Nvidia Blackwell RTXPro GPU on the Rocket 7638D switch fabric: 

Gen4 Platform Performance: HighPoint GDS Vs. Standard Host-Routed Architecture 

AI solution Image1.png
AI solution Image2.png

Hardware GDS vs. Conventional CPU-GPU Relayed Path:

Doubles Gen4 Platform Bandwidth (28 GB/s → 57 GB/s): On a legacy PCIe Gen4 server, HighPoint's localized switch fabric doubles storage-to-GPU throughput from 28,087 MB/s to 57,264 MB/s (a 2.04x increase), achieving 99.9% performance parity with native Gen5 platforms.

 

Eliminating Host CPU Saturation (99.5% → 12.0% / 7.1%): Conventional CPU-GPU routing pushes host CPU utilization to a crippling 99.5% on Gen4 systems (and 98% on Gen5 systems). Hardware GDS slashes CPU overhead to just 12.0% on Gen4 and 7.1% on Gen5, freeing host cores entirely for application logic and network ingestion.

 

40% Latency Reduction: Drops round-trip storage-to-VRAM access latency from 116.1 µs to 69.4 µs on Gen4 (and down to 55.0 µs on native Gen5), providing deterministic, microsecond response times for real-time inference and model checkpointing.

Need More Details?

If you would like to receive the complete Validation report, please submit the following: Report Request

Three Modular AI Upgrade Architectures

No single physical layout addresses every edge constraint. HighPoint provides three modular PCIe Gen5 switching topologies engineered to overcome specific physical, thermal, and I/O bottlenecks without requiring a host platform refresh.

Structural Blueprint
Core Engineering Objective
Interconnect & Hardware Path
Best Suited For
Horizontal Direct PCIe Expansion (Single-Tier Direct P2P)
Zero-Hop Minimum Latency (~100-150 ns): Full line-rate 64 GB/s non-blocking throughput directly between NVMe storage & GPU VRAM
Single-Tier Internal Switch: Rocket 7638D / 1628A with direct PCIe & Internal MCIO 8i
Real-time computer vision, interactive edge LLM inference & high-frequency telemetry.
Vertical / Cascading PCIe Expansion (Multi-Tier Lane Multiplication)
Extreme Lane & Port Multiplication: Solves slot starvation by splitting 1 host slot into independent downstream device tiers without motherboard bifurcation
Multi-Tier Cascaded Hierarchy: Rocket 1628A -> MCIO Bridge -> Rocket 1528D
Multi-sensor vehicle logging, high-density RAG vector staging & surveillance aggregation.
Disaggregated External Accelerators (Decoupled Power & Compute)
Decoupled Power & Thermal Footprint: Supports 600W workstation GPUs outside 1U/2U servers with dedicated 1300W power & active cooling.
Cabled External Sub-Fabric: Rocket 7634D / R7638D / 1638E + CopprLink CDFP x16 + RocketStor 8631D
1U/2U compact edge racks, mobile medical carts & virtual VFX production workstations.

Read the Full Engineering Guide: Architecting Edge AI — Horizontal, Cascading, and Disaggregated Topologies.

Hardware Architecture & Product Matrix

1 - Horizontal Direct PCIe Expansion (Single-Tier Low Latency)

Best For: Real-time edge inference, token caching, live prompt fine-tuning, and algorithmic trading nodes.

 

Hardware Matrix: 

R1628A_left tilt_v1.02_24_27.png

Rocket 1638E

PCIe Gen5 x16 2x CopprLink Switch Adapter

  • 2x CopprLink CDFP Port  

      (External - PCIe Gen5 x16)

R1628A_left tilt_v1.02_24_27.png

Rocket 7638D

PCIe Gen5 x16 CopprLink/MCIO Hybrid Switch Adapter

  • 1x CopprLink CDFP Port (External - PCIe Gen5 x16)

  • 2x MCIO Ports (Internal - PCIe Gen5 x8)

2 - Vertical / Cascading PCIe Expansion (Multi-Tier Lane Multiplication)

Best For: High-density dataset ingestion nodes, mobile data collection vehicles, and local Retrieval-Augmented Generation (RAG) vector staging.

 

Hardware Matrix: 

R1628A_left tilt_v1.02_24_27.png

Rocket 1628A

PCIe Gen5 x16 NVMe Adapter 

  • 4x MCIO Ports (PCIe Gen5 x8)

R1628A_left tilt_v1.02_24_27.png

Rocket 1528D

PCIe Gen4 x16 NVMe Adapter

  • 4x SlimSAS Ports (PCIe Gen4 x8)

3 - Disaggregated External Compute (Decoupled 1300W Power & Active Cooling)

Best For: Compact 1U/2U rackmount servers, mobile imaging carts, and workstations constrained by chassis dimensions and power limits.

 

Hardware Matrix: Rocket 7634D (Pure External) or Rocket 7638D (Hybrid External + Internal) + RocketStor 8631D-1300W/8631C-600W Enclosures.

R1628A_left tilt_v1.02_24_27.png

RocketStor 8631DW: PAE Single-GPU Expansion Bundle

Native PCIe Gen5 x16 (64 GB/s) Accelerator Expansion for Quiet 1U/2U Server & Workstation Environments

Supports 1x GPU/Accelerator

R1628A_left tilt_v1.02_24_27.png

RocketStor 8631DH: PAE Compute & NVMe Storage Bundle

Unified PCIe Gen5 x16 GPU & Dual MCIO NVMe Storage Fabric for Direct GDS Data Ingestion

Supports up to 1x GPU Accelerator & up to 16 NVMe Drives

R1628A_left tilt_v1.02_24_27.png

RocketStor 8631DD: PAE Dual-Port Scalable Compute Bundle

Dedicated Dual Gen5 x16 Fabric with Switch-Level DMA & Host Bypass for Scaled AI & Simulation

Supports up to 2x GPU/s Accelerators

R1628A_left tilt_v1.02_24_27.png

Rocket 7638D

PCIe Gen5 x16 CopprLink / MCIO Hybrid Switch Adapter

  • 1x CopprLink CDFP Port  

     (External - PCIe Gen5 x16)

  • 2x MCIO Ports 

     (Internal - PCIe Gen5 x8)

R1628A_left tilt_v1.02_24_27.png

Rocket 7634D

PCIe Gen5 x16 CopprLink Switch Adapter

  • 1x CopprLink CDFP Port 

      (External - PCIe Gen5 x16)

R1628A_left tilt_v1.02_24_27.png

RocketStor 8631D

PCIe Gen5 x16 CopprLink eGPU Enclosure

  • 1x CopprLink CDFP Port 

      (External - PCIe Gen5 x16)

Learn More About HighPoint's AI Upgrade Architecture

Technical Ecosystem Documentation & Engineering Guides

Explore in-depth silicon-level switching architecture, hardware P2P DMA implementation, and zero-copy data path blueprints.

Technical Blog: Why Cabled AI Accelerators Fail Without the Right Architecture: CopprLink™ vs. OCuLink & Host-Routed vs. P2P Switching

Technical Blog: Architecting Edge AI- Horizontal, Vertical Cascading, and Disaggregated PCIe Gen5 Topologies

Architectural White Paper: Architecting Edge AI: Horizontal, Vertical Cascading, and Disaggregated PCIe Gen5 Topologies

bottom of page