←back to thread

144 points M_farhan_h | 2 comments | | HN request time: 0.422s | source
1. rgovostes ◴[] No.45306762[source]
You mention that this is a USB HID device a few times but how are you capturing the display? Does ReplayKit broadcasting give you access? Or is the hardware also acting as an HDMI capture card or something?
replies(1): >>45311865 #
2. mrlambchop ◴[] No.45311865[source]
Poking around at this product, it looks from the rendering like (a) USB-C based power pass through (unclear if its 2.0 BC etc... or true PD with CC pins - doesn't matter that much however if the phone range is small enough) (b) USB 2.0 device IC (STM32 or similar?) that connects to the phone over D+/D- pins. (c) power is being taken from the USB internal or external depending on what is plugged in.

I was confused by how CarPlay was working, as this requires the vehicle to be a host and the phone a device, but I'll assume it means wireless CarPlay (vs USB 2.0 CarPlay).

For the display, I wonder if the device is mimicking the assistive touch inputs via external USB PID (per the note) and using a mouse/trackpad HID can take a screenshot via assistive framework - I guess the app could see this arriving, process it and then delete? Also figure out what is being shown? would explain why the video is sped up a little, but YIKES. Also good luck stopping the app being killed in the background.

All direct USB streams require MFI auth, which might work for exactly 100 devices and could be an alternative, but requires Apple cert for bulk quantities.

I think ReplayKit can only work within an app and can't see the general output stream.

Cool use of tech and curious to see how it actually works :)