That’s great, thanks for sharing! @easone is working to add Teensy 4.0/4.1 support using FlexBus to SmartMatrix Library. I don’t know if that helps you, or if you’re already set on the Teensy 3.6:
(there’s not details of the port in that thread yet, but the driver is going to focus on the pins accessible with just the Teensy 4.0, and a single HUB75 output. I’ll be working on a shield for the Teensy 4)