ViralLoop

Chunky beast, needs 320 Gb VRAM likely 4 bit, likely is being run 8 bit on 8 x 80 Gb GPUs. As 25% of weights active any given time runs at 70b LLaMA 2 speeds. MoE models tail off larger so this is very interesting to test to see tradeoffs.

229 likes9 repliesPosted Mar 17, 2024

Remix this post

Your note

Private to you, and used when you remix this post.

Viral score

Based on absolute engagement — the platform doesn’t expose follower counts here, so large accounts score higher.

From likes, comments.

Why it worked

Leads with a specific number, which is concrete enough to be worth a second of attention.
Uses concrete numbers instead of vague claims, which makes it credible and quotable.
Follows a clear Hook → Context → Landing shape, so the reader always knows where they are.
Ends on a short line that is easy to quote and repeat.
Short enough to read in full without expanding, which removes a step before the point lands.
Short sentences keep the pace up, so the reader never has to re-read a line.

The mechanics

Hook: Leads with a number
Structure: Hook → Context → Landing
Style: Conversational paragraphs at a steady pace.
Tone: concrete, punchy
Mechanisms: Specificity
Written for: People building with AI

Analysis by ViralLoop — not written by the original author.

Post by Emad on X