Microphone support #23
Labels
No labels
bug
documentation
duplicate
enhancement
good first issue
help wanted
invalid
question
stale
wontfix
No milestone
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set
Reference
gh-streetpea/chiaki-ng#23
Loading…
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Various people have requested being able to use a microphone to use PlayStation voice chat via Chiaki. Right now the best solution for Steam Deck is probably using the Discord app via the flatpak. However, some users don’t like that / have friends playing on PlayStation that would like to use PlayStation chat. I’m opening this as an issue to look at once some of the other features are finished or if someone else wants to take a stab at this.
I second this, microphone support is one of the pillars which is holding Chiaki back from being truly great . An added plus would be the abiliy to use regular non-mic headohones with the built-in steamdeck mic like on dualsense controllers.
while this is being worked on (hopefully) any idea if using the pulse headset while in same room as ps5 could be a workaround? Considering buying one for this
Do you know if the microphone works in the official remote play app? I think I've tried it once with the Astro Controller Demo but could not get it to work.
Yes it works in the official app. Through controller or any input on pc. Works with deck mic when running on windows
Thanks, so that will probably require some more reverse engineering, currently there's nothing in Chiaki regarding mic support.
It’s in the takion.proto in several places such as:
github.com/streetpea/chiaki4deck@29da0f5969/lib/protobuf/takion.proto (L373)and here: https://github.com/streetpea/chiaki4deck/blob/main/lib/protobuf/takion.proto#L38 though the mic/micconnection doesn’t seem to be linked into Chiaki other than sending a default mute type. For example, there is no link to the micconnection in the stream connection code (or seemingly any other Chiaki code for that matter). In contrast, the controller connection from takion.proto is referenced here)Is this still being worked on?
hello, sorry to disturb you. Are you still working on chiaki4deck? Because I wanted to use the microphone is I saw that it was not yet available. Thank you very much and again sorry
I stopped working on it for a while but I will start working on it again.
Thank you! Microphone support is going to be a game changer for sure
(literally!).
On Thu, May 25, 2023 at 10:25 PM streetpea @.***> wrote:
Thank you! This would be epic. Let me know if there’s a way to support or help!
If mic was working, I would never need to sit down at the actual PS5 again.
It’d be amazing if you can support this 😍
Mic is being worked on at https://github.com/streetpea/chiaki_mic. @jbaiter have you looked at mic support at all? I'm trying to add mic support and able to form audio messages via recorded audio that I send over takion (
github.com/streetpea/chiaki_mic@f3128a4ac6/lib/src/takion.c (L566)) but right now nothing is happening. I tried piping these audio messages to the playback function for received audio in this branch (https://github.com/streetpea/chiaki_mic/tree/audio-test) as a test and that works (I can hear recorded audio played back via the speaker ... i.e., decrypted, opus decoded and then played back) so it seems that the audio packets are correctly formed and the encryption follows what's done for the controller feedback packets (github.com/streetpea/chiaki_mic@4acaecf265/lib/src/takion.c (L513)). However, given the audio test shows no audio, clearly something is wrong. I have been talking to Florian Grill (he implemented mic in PS Play) and it seems to be very close to what he has so is at least close to being correct...do you have any insight into this?Note: I'm implementing this in base Chiaki first and after submitting a pull request (i.e., git send-email) there will add to chiaki4deck so now it's just based off of the latest Chiaki code.
Sorry, I haven't look into it very closely :-( I was going to point you to Florian Grill as well 😅 Maybe he can send you some decrypted packet dumps and you can compare?
From my tests (playback of encrypted message) it seems like the audio message is being formed correctly but Florian Grill is going to send me a sample before encryption for a given audio input to check...if we get the same result then it must be something with the encryption/gmac but I'm hoping it's not that bc debugging that could prove challenging.
@jbaiter so Florian Grill helped me check the audio message and the encryption and it appears to be in order but it's still not working so there appears to be something missing but not sure what it is. Florian thinks that should be everything though so it's a bit of a mystery what's going wrong.
Update: I found the missing message sent over 9296 ... it works now on my computer! I'll push an update with mic support soon (I'll submit it upstream to chiaki and release it for chiaki4deck in the next week or so). Florian Grill was very helpful as well :)
added with 1.4.0 with commit
6fc4b8f6e4