Everything looks fine at 4-bit
Jun 9, 2026âąChannel
AI Analysis
Data from YouTube Data API v3âąUpdated Just now
Video Overview
Video Details
Published1 week ago
Duration1:18
Video IDGjQFRXaSChM
Languageen
CategoryScience & Technology
PrivacyPublic
Made for KidsNo
Video TypeRegular Video
Performance Metrics
Views7.2K
Likes218
Comments6
Engagement Rate3.10%
Likes per 100 views3.02
Comments per 1K views0.83
Video Tags
Description
I quantized one model 8 ways to find the exact level it starts making things up.
đ Gear Links đ
đŠ RTX Pro 6000: https://bhpho.to/4nTVL8S
đ»â Thunderbolt 5 external SSD: https://amzn.to/3XqetZO
đ»â Favorite 15" display with magnet: https://amzn.to/3zD1DhQ
đ§âĄ Great 40Gbps T4 enclosure: https://amzn.to/3JNwBGW
đ ïžđ My nvme ssd: https://amzn.to/3YLEySo
đŠđź My gear: https://www.amazon.com/shop/alexziskind
đ„ Related Videos đ„
đ CodeNeedle video - https://youtu.be/zBYfzecY5ww
đ Skip M3 Ultra & RTX 5090 for LLMs | NEW 96GB KING - https://youtu.be/bAao58hXo9w
đ» Smallest RTX Pro 6000 rig | OVERKILL - https://youtu.be/JbnBt_Aytd0
đ§ Cheap mini runs a 70B LLM đ€Ż - https://youtu.be/xyKEQjUzfAk
đ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M
đ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo
đȘ REALITY vs Appleâs Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A
đŠ Set up Conda - https://youtu.be/2Acht_5_HTo
đ€ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
* đ ïž Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
đ AI for Coding Playlist: đ - https://www.youtube.com/playlist?list=PLPwbI_iIX3aSlUmRtYPfbQHt4n0YaX0qw
â â â â â â â â â
â€ïž SUBSCRIBE TO MY YOUTUBE CHANNEL đș
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
â â â â â â â â â
Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
â â â â â â â â â
đ± ALEX ON X: https://twitter.com/digitalix
#macmini #llm #nvidia