Oddly enough, that’s exactly what I’ve been benchmarking - different ways of linking Strix Halo machines - with respect to throughput & latency.
Posted a little bit re: the TB side of things on the Framework and Level1Techs forums but haven’t pulled everything together yet because the higher-speed Ethernet and Infiniband data is still being collected.
So far my observations re: TB is that, on Strix Halo specifically, while latency can be excellent there seem to be some limits on throughput. My tests cap out at ~11Gbps unidir (Tx|Rx), ~22Gbps bidi (Tx+Rx). Which is wierd because the USB4 ports are advertised at 40Gbps bidi, the links report as 2x20Gbs, and are stable with no errors/flapping - so not a cabling problem.
The issue seems rather specific to TB networking on Strix Halo using the USB4 links between machines.
Emphasis to exclude common exceptions - other platforms eg Intel users getting well over 20Gbps; other mini PCs eg MS-1 Max USB4v2; local network eg I’ve measured loopback >100Gbps; or external storage where folk are seeing 18Gbps+ / numbers that align with their devices.
Emd goal is to get hard data on all reasonably achievable link types. Already have data on TB & lower-speed Ethernet (switched & P2P), currently doing setup & tuning on some Mellanox cards to collect data for higher-speed Ethernet and IB. P2P-only for now; 100GbE switching is becoming mainstream but IB switches are still rather nutty.
Happy to collaborate with any other folk interested in this topic. Reach out to (username at pm dot me).
I do media production, and sometimes move giant files (like ggufs) around my network, so 25 Gbps is more useful than 10 Gbps, if it's no too expensive.
Iomega's awesome Zip drive disk (100MB, 250MB, 750MB capacities) , I think I still have a 250MB zip drive somewhere in my home attic.
They required a dedicated zip drive (took up same sized slot/bay as a floppy disk drive), but (if I recall right) that drive was backward compatible standard 3&1⁄2-inch 1.44MB floppy disks.
Interestingly, these drive also came in variants to work with different types of interfaces: IDE, ATAPI, USB, SCSI, FireWire.
Zip drives filled the portable storage niche, until CDs and DVDs replaced their need.
I found it cool that floppies and superfloppies had label stickers on which we can write (with a sketch pen) to remind the user of what content the disk is intended for.
There were some nice cameras that used Zip disks for storage! Very convenient for photographers working on multiple projects or sessions.
> They required a dedicated zip drive (took up same sized slot/bay as a floppy disk drive), but (if I recall right) that drive was backward compatible standard 3&1⁄2-inch 1.44MB floppy disks.
Zip was a completely unique physical format, and had no backwards compatibility with standard 3½" disks.
SuperDisk, on the other hand (in both the LS-120 and LS-240 variants) was backwards compatible with standard floppy disks in the same drive.
Latest for me was the ill-fated "mini VGA" cable Apple used on like 2 iBooks and the original Xserves... I couldn't find one when I needed it. But now I have like 8 of them, which I got in a box of random old Mac stuff recently!
Indeed, that video was half of the inspiration for writing up this blog post (and is linked in the footnotes!). Always amazed by the depth of his tests for videos that are published on a weekly schedule.
Ha, there's one radio clock in my house that I still keep going for sentimental reasons... it's had a rough time setting itself for a few years, likely due to its placement in the house.
I'll have to test this out sometime, what a fun idea!
I still mourn the loss of Aperture. IMO the best pro software Apple ever made. Lightroom was always a distant second for RAW photo workflows, and Photos is still a far cry.
I think where it would show more significant speed up is on the AMD Strix Halo cluster.
Except I haven't been able to get RDMA over Thunderbolt on there to work, so it'd be apples to oranges comparing ConnectX to Thunderbolt on Linux.
reply