Communication cost modeling for tensor parallel LLM inference with TP vs PP vs hybrid comparison, VRAM analysis, pipeline bubble modeling, regime detection, and cost-efficiency. Shows TP dominates on NVLink, PP has 47% bubble at 8 GPUs, and LLaMA-70B needs 8× A100 or 2× H100 for VRAM.

Code accompanying the paper: Communication-Efficient Publication of Sparse Vectors under Differential Privacy via Poisson Private Representation

Data Analysis, Data Science, DBLP Social Network, Social Network Analysis, Structural clustering algorithm for networks, WSAN, TFP-WSCAN,