Can't recording 720P .mp4 (H264) video #49
Comments
|
Hi, Any update with this issue? I know Kurento is in low mantainance mode, but I think there are a possible compatibility issue in Kurento with new H264/X264 releases of 2024. I reproduce same behaviour in iOS 17.4 devices in Safari. It happens 80% of connections. When everything works fine, there are no WARN/ERROR logs related to this, but sometimes, Kurento in latest version (7.0.1) prints: (enabling MKV): Enabling MP4: Curiously, we receive correctly images in our custom OpenCV filter (we're saving all frames Kurento receive for testing purposes) but final video is pixelated, trimmed, partially black... Could be related to transcoding or something like that? According to GStreamer errors, it seems an incompatibility issue. Any light on that? By the way, I reproduce same behaviour in OpenVidu demo with Kurento backend. Regards. |
|
Could it be related to old issue Kurento/bugtracker#535? As far as I saw in @j1elo comments, no fix was implemented (because matroska and VP8). I don't know if at least, you have a workaround. Regards. |
|
The problem is exactly issue Kurento/bugtracker#535, as mentioned above, and it stems from this: Problem was that Kurento got upgraded to use the GStreamer dependency that comes with Ubuntu 20.04 (GStreamer 1.16), but it turns out that this came with breaking changes in behaviors (I guess at some point they considered it a bug but then changed their mind and considered it a regression, but in the meantime a release was cut, published, and ended up being part of Ubuntu). Solution is not small as it would consist on researching a bit about that GStreamer issue, see which commits fixed the problem, then locate which releases already contain the commit(s) to be clear on what GStreamer version needs to be used. And then, the major part, upgrading Kurento to make it work with that version. It's not a trivial thing to do because GStreamer sometimes changes internals such that old code needs to be changed in order to use newer versions of the library. I'd like to get some of my own time at some point to do the upgrade. For now, may I suggest you try using the latest available version of Kurento 6.x? |
|
Seems that I had done the initial part that I mentioned: Kurento/bugtracker#535 (comment) So GStreamer >= 1.20 seems to contain the fixes already. But as the next comment in that issue points out, there seem to be some other additional issues when using those newer versions of GStreamer! No doubt, those corruption issues come probably from the fact that the user who tested with GStteamer 1.21 tried to use Kurento 7 as-is, without the work to adapt it to possible breaking changes. As expected, some work needs to be done explicitly to support newer versions of the library, it cannot be used as-is like nothing bad would happen. |
|
Hi @j1elo Thanks for your quick response. I think I 've understood properly root cause of problem. I got your advice to rollback to previos Kurento versión (6.18.0) but I've been looking for a quick solution and I found (already deprecated) degradationPreference parameter (https://developer.mozilla.org/en-US/docs/Web/API/RTCRtpSender/setParameters#degradationpreference) and I think it could be a mitigation and possible cause of behaviour we're experiencing since iOS 17.4. According to iOS 17.4 release notes, they "fixed" degradationPreference's "mantain-framerate" option (https://developer.apple.com/documentation/safari-release-notes/safari-17_4-release-notes#WebRTC) and It seems they fixed "balanced" option too (which is default value), so probable it's related to our recent problem. When I have a chance to test It, I'll come back to share my results. Regards. |
|
Hi all, In case it helps to anyone, issue for me is solved setting "degradationPreference" parameter to "mantain-resolution". Sample code: Anyway, this is a mitigation because Kurento shouldn't crash. Do you have plans to upgrade it to latest version of Gstreamer? I think I could help in case is needed. Regards. |
Prerequisites
These are MANDATORY, otherwise the issue will be automatically closed.
Issue description
even change conferenceroom.js media constraints.
Context
I'm trying to accomplish this:
Application Server: Demo Project revised from Tutorial-GroupCall & focal-gstreamer-build-from-source (docker image)
GStreamer Core Library version 1.16.3I pull media server image for test recording:
docker pull kurento/kurento-media-server, and setup my own media server on AWS EC2 test recording separately.Both server's video resolution always 640 x 480.
At Fisrt, I thought was Browser or JS WebRTC API problem, use different client to call application server
Browser Result:
When first participant join room and room Created immediately recording
Application Server Log & Media info
General Format : MPEG-4 Format profile : Base Media / Version 2 Codec ID : mp42 (mp42/mp41/isom/iso2) File size : 121 MiB Duration : 10 min 4 s Overall bit rate : 1 683 kb/s Frame rate : 29.708 FPS Video ID : 1 Format : AVC Format/Info : Advanced Video Codec Format profile : Constrained Baseline@L3 Format settings : 1 Ref Frames Format settings, CABAC : No Format settings, Reference frames : 1 frame Codec ID : avc1 Codec ID/Info : Advanced Video Coding Duration : 10 min 4 s Bit rate : 1 681 kb/s Width : 640 pixels Height : 480 pixels Display aspect ratio : 4:3 Frame rate mode : Variable Frame rate : 29.708 FPS Minimum frame rate : 12.500 FPS Maximum frame rate : 33.223 FPS Color space : YUV Chroma subsampling : 4:2:0 Bit depth : 8 bits Scan type : Progressive Bits/(Pixel*Frame) : 0.184 Stream size : 121 MiB (100%) Codec configuration box : avcCMedia Constraints set over 480P, then call application server, media server will occur errors.
Application Server Error Message:
INFO 26856 --- [nio-8443-exec-3] o.k.t.helloworld.HelloWorldRecHandler : Msg = {"sdpOffer":"v=0\r\no=- 7534497441325278218 2 IN IP4 127.0.0.1\r\ns=-\r\nt=0 0\r\na=group:BUNDLE 0 1\r\na=extmap-allow-mixed\r\na=msid-semantic: WMS e23689bd-a398-45e5-983c-61500e37ef58\r\nm=audio 9 UDP/TLS/RTP/SAVPF 96 97 98 99 102 103 104 9 0 8 100 101 107 108 109 114 106 105 13 110 112 113 126\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:eE2Z\r\na=ice-pwd:EWlMKIfJRI3O8aRCPsGkRL/J\r\na=ice-options:trickle\r\na=fingerprint:sha-256 0F:EF:EE:49:1D:0D:CF:E7:1D:93:23:14:7C:B5:5A:48:C4:E8:F0:B5:F5:53:58:A7:B1:77:13:D9:51:D1:E1:57\r\na=setup:actpass\r\na=mid:0\r\na=extmap:1 urn:ietf:params:rtp-hdrext:ssrc-audio-level\r\na=extmap:2 https://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:3 https://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:4 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=sendonly\r\na=msid:e23689bd-a398-45e5-983c-61500e37ef58 40b0900d-5984-4f21-9760-e92fae3dadec\r\na=rtcp-mux\r\na=rtpmap:96 opus/48000/2\r\na=rtcp-fb:96 transport-cc\r\na=fmtp:96 minptime=10;sprop-stereo=1;stereo=1;useinbandfec=1\r\na=rtpmap:97 red/48000/2\r\na=fmtp:97 96/96\r\na=rtpmap:98 multiopus/48000/6\r\na=fmtp:98 channel_mapping=0,4,1,2,3,5;coupled_streams=2;minptime=10;num_streams=4;useinbandfec=1\r\na=rtpmap:99 multiopus/48000/8\r\na=fmtp:99 channel_mapping=0,6,1,2,3,4,5,7;coupled_streams=3;minptime=10;num_streams=5;useinbandfec=1\r\na=rtpmap:102 ILBC/8000\r\na=rtpmap:103 ISAC/16000\r\na=rtpmap:104 ISAC/32000\r\na=rtpmap:9 G722/8000\r\na=rtpmap:0 PCMU/8000\r\na=rtpmap:8 PCMA/8000\r\na=rtpmap:100 L16/8000\r\na=rtpmap:101 L16/16000\r\na=rtpmap:107 L16/32000\r\na=rtpmap:108 L16/8000/2\r\na=rtpmap:109 L16/16000/2\r\na=rtpmap:114 L16/32000/2\r\na=rtpmap:106 CN/32000\r\na=rtpmap:105 CN/16000\r\na=rtpmap:13 CN/8000\r\na=rtpmap:110 telephone-event/48000\r\na=rtpmap:112 telephone-event/32000\r\na=rtpmap:113 telephone-event/16000\r\na=rtpmap:126 telephone-event/8000\r\na=ssrc:1764116073 cname:7BLBakQZ05pz0K96\r\na=ssrc:1764116073 msid:e23689bd-a398-45e5-983c-61500e37ef58 40b0900d-5984-4f21-9760-e92fae3dadec\r\nm=video 9 UDP/TLS/RTP/SAVPF 123 122 121 120\r\nc=IN IP4 0.0.0.0\r\na=rtcp:9 IN IP4 0.0.0.0\r\na=ice-ufrag:eE2Z\r\na=ice-pwd:EWlMKIfJRI3O8aRCPsGkRL/J\r\na=ice-options:trickle\r\na=fingerprint:sha-256 0F:EF:EE:49:1D:0D:CF:E7:1D:93:23:14:7C:B5:5A:48:C4:E8:F0:B5:F5:53:58:A7:B1:77:13:D9:51:D1:E1:57\r\na=setup:actpass\r\na=mid:1\r\na=extmap:14 urn:ietf:params:rtp-hdrext:toffset\r\na=extmap:2 https://www.webrtc.org/experiments/rtp-hdrext/abs-send-time\r\na=extmap:13 urn:3gpp:video-orientation\r\na=extmap:3 https://www.ietf.org/id/draft-holmer-rmcat-transport-wide-cc-extensions-01\r\na=extmap:5 https://www.webrtc.org/experiments/rtp-hdrext/playout-delay\r\na=extmap:6 https://www.webrtc.org/experiments/rtp-hdrext/video-content-type\r\na=extmap:7 https://www.webrtc.org/experiments/rtp-hdrext/video-timing\r\na=extmap:8 https://www.webrtc.org/experiments/rtp-hdrext/color-space\r\na=extmap:4 urn:ietf:params:rtp-hdrext:sdes:mid\r\na=extmap:10 urn:ietf:params:rtp-hdrext:sdes:rtp-stream-id\r\na=extmap:11 urn:ietf:params:rtp-hdrext:sdes:repaired-rtp-stream-id\r\na=sendonly\r\na=msid:e23689bd-a398-45e5-983c-61500e37ef58 435f9231-b06e-430a-9c89-4253a07dd83c\r\na=rtcp-mux\r\na=rtcp-rsize\r\na=rtpmap:123 H264/90000\r\na=rtcp-fb:123 goog-remb\r\na=rtcp-fb:123 transport-cc\r\na=rtcp-fb:123 ccm fir\r\na=rtcp-fb:123 nack\r\na=rtcp-fb:123 nack pli\r\na=fmtp:123 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e033\r\na=rtpmap:122 H264/90000\r\na=rtcp-fb:122 goog-remb\r\na=rtcp-fb:122 transport-cc\r\na=rtcp-fb:122 ccm fir\r\na=rtcp-fb:122 nack\r\na=rtcp-fb:122 nack pli\r\na=fmtp:122 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=420033\r\na=rtpmap:121 H264/90000\r\na=rtcp-fb:121 goog-remb\r\na=rtcp-fb:121 transport-cc\r\na=rtcp-fb:121 ccm fir\r\na=rtcp-fb:121 nack\r\na=rtcp-fb:121 nack pli\r\na=fmtp:121 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=640033\r\na=rtpmap:120 H264/90000\r\na=rtcp-fb:120 goog-remb\r\na=rtcp-fb:120 transport-cc\r\na=rtcp-fb:120 ccm fir\r\na=rtcp-fb:120 nack\r\na=rtcp-fb:120 nack pli\r\na=fmtp:120 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=4d0033\r\na=ssrc:2589173544 cname:7BLBakQZ05pz0K96\r\na=ssrc:2589173544 msid:e23689bd-a398-45e5-983c-61500e37ef58 435f9231-b06e-430a-9c89-4253a07dd83c\r\n","mode":"both","id":"start"} 2023-07-18 17:52:15.108 INFO 26856 --- [nio-8443-exec-3] o.k.t.helloworld.HelloWorldRecHandler : Answer = v=0 o=- 3898662735 3898662735 IN IP4 0.0.0.0 s=Kurento Media Server c=IN IP4 0.0.0.0 t=0 0 a=extmap-allow-mixed a=msid-semantic: WMS e23689bd-a398-45e5-983c-61500e37ef58 a=group:BUNDLE 0 1 m=audio 1 UDP/TLS/RTP/SAVPF 96 0 a=extmap:2 https://www.webrtc.org/experiments/rtp-hdrext/abs-send-time a=recvonly a=mid:0 a=rtcp:9 IN IP4 0.0.0.0 a=rtpmap:96 opus/48000/2 a=rtpmap:0 PCMU/8000 a=setup:active a=rtcp-mux a=fmtp:96 minptime=10;sprop-stereo=1;stereo=1;useinbandfec=1 a=ssrc:463513865 cname:user2910986067@host-fc420bb3 a=ice-ufrag:zi4s a=ice-pwd:lrJN7V1sNGZBwVdQQjGaKQ a=fingerprint:sha-256 C3:8F:8C:12:C6:AA:11:ED:2E:24:A4:86:35:56:04:32:94:83:26:7B:40:8B:13:69:8B:E8:2F:2C:CA:2F:9A:E5 m=video 1 UDP/TLS/RTP/SAVPF 123 122 121 120 a=extmap:2 https://www.webrtc.org/experiments/rtp-hdrext/abs-send-time a=recvonly a=mid:1 a=rtcp:9 IN IP4 0.0.0.0 a=rtpmap:123 H264/90000 a=rtpmap:122 H264/90000 a=rtpmap:121 H264/90000 a=rtpmap:120 H264/90000 a=rtcp-fb:123 goog-remb a=rtcp-fb:123 ccm fir a=rtcp-fb:123 nack a=rtcp-fb:123 nack pli a=rtcp-fb:122 goog-remb a=rtcp-fb:122 ccm fir a=rtcp-fb:122 nack a=rtcp-fb:122 nack pli a=rtcp-fb:121 goog-remb a=rtcp-fb:121 ccm fir a=rtcp-fb:121 nack a=rtcp-fb:121 nack pli a=rtcp-fb:120 goog-remb a=rtcp-fb:120 ccm fir a=rtcp-fb:120 nack a=rtcp-fb:120 nack pli a=setup:active a=rtcp-mux a=fmtp:123 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=42e033 a=fmtp:122 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=420033 a=fmtp:121 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=640033 a=fmtp:120 implementation_name=NvCodec;level-asymmetry-allowed=1;packetization-mode=1;profile-level-id=4d0033 a=ssrc:3347471582 cname:user2910986067@host-fc420bb3 a=ice-ufrag:zi4s a=ice-pwd:lrJN7V1sNGZBwVdQQjGaKQ a=fingerprint:sha-256 C3:8F:8C:12:C6:AA:11:ED:2E:24:A4:86:35:56:04:32:94:83:26:7B:40:8B:13:69:8B:E8:2F:2C:CA:2F:9A:E5 ERROR 26856 --- [EventExec-e2-t7] o.k.t.helloworld.HelloWorldRecHandler : [RecorderEndpoint::ErrorEvent] Error code 1: 'STREAM_ERROR_FAILED', source: d9431e68-3a83-46e3-b50b-ecfcde68d2e3_kurento.MediaPipeline/640aeaa9-a655-4066-b5c9-f6103d819010_kurento.RecorderEndpoint, timestamp: 1689673935353, tags: [], description: Error code 1: Internal data stream error., source: kmsrecorderendpoint2, element: kmsrecorderendpoint2, debug info: gstbasesrc.c(3072): gst_base_src_loop (): /GstPipeline:pipeline4/GstAppSrc:videoSrc: streaming stopped, reason not-negotiated (-4)With this approach, it's challenging for me, especially I'm not familiar C programming language and Linux.
I'm unsure if it will work or not, but I give it a try.
However, still unable to recording and identify the root cause of the issue.
with 1.20 / 1.22, Group-Call, media server same Log info:
#359, #372, #535, #641, #642;How to reproduce?
Expected & current behavior
(Optional) Possible solution
Info about your environment
configs
WebRtcEndpoint.conf.iniSdpEndpoint.conf.json{ "numAudioMedias": 1, "numVideoMedias": 1, "audioCodecs": [ { "name": "opus/48000/2", "//": "Next is an example about how a codec can be configured.", "//": "WARNING: Usage of properties is not yet supported", "//properties": { "//maxcodedaudiobandwidth": "16000", "//maxaveragebitrate": "20000", "//stereo": "1", "//useinbandfec": "1", "//usedtx": "0" } }, { "name": "PCMU/8000" }, { "name": "AMR/8000" } ], "videoCodecs": [ { "name": "H264/90000" } ] }MediaElement.conf.iniAbout Kurento Media Server
About your Application Server
About end-user clients
Run these commands
DISTRIB_ID=Ubuntu DISTRIB_RELEASE=20.04 DISTRIB_CODENAME=focal DISTRIB_DESCRIPTION="Ubuntu 20.04.6 LTS"The text was updated successfully, but these errors were encountered: