[Freeswitch-users] rtp-timer-name / timer issues

Tue Feb 6 02:38:56 UTC 2018

Appreciate the info. We're running on Kernel 4.4.0, with freeswitch 1.9.0
(compiled from git). Large differences on versions there but this seems so
fundamental and core to FS that I'd be surprised if later versions made
things worse. That said, I'm not sure when things like timerfd became
standard in freeswitch, and/or if that (or related concerns) could cause
the issue. We're also running in Docker, but we run it without any limits
(and can replicate the issue running outside of a conctainer).

Similar situation, TLS Websocket w/ DTLS-SRTP on one side and standard
TLS+SRTP on the other. All of our issues appear to occur on the WebRTC
legs, however, which would leads me to lean towards network issues being
the primary culprit. However, iperf shows 400Mbps easily (and consistently)
between the endpoints. Issue occurs whether we do G.711 on both ends, or
opus on the public internet side (although opus PLC can help mask some of
the issues)

Just to be clear, the audio is still intelligible, there's just noticeable
dropped packets every 5-10 seconds on average.

Do you know what timer your instance is using? And your settings for
rtp-timer-name?

Thanks again,
Colin

On Mon, Feb 5, 2018 at 9:28 PM, Geoff Mina <gmina at connectfirst.com> wrote:

> Stock CentOS w/ Kernel 3.10.0-693.el7.x86_64.  Freeswitch 1.6.19~64bit
>
> We have TLS Websocket /DTLS-SRTP connections on one side and standard UDP
> SIP on the other.  Both sides using G.711, so no transcoding.
>
>
>
>
> On Mon, Feb 5, 2018 at 7:07 PM, Colin Morelli <colin.morelli at gmail.com>
> wrote:
>
>> Ubuntu 16.04 LTS. Do you have any custom kernel settings or just a stock
>> CentOS instance?
>>
>> On Mon, Feb 5, 2018 at 8:23 PM Geoff Mina <gmina at connectfirst.com> wrote:
>>
>>> What OS are you using? We run FS at over 600 concurrent calls on a
>>> smaller EC2 (c4.xlarge) size and have not had any issues in either US-East
>>> or US-West.
>>>
>>> Running FS Installed from YUM. CentOS7.
>>>
>>> > On Feb 5, 2018, at 5:56 PM, Colin Morelli <colin.morelli at gmail.com>
>>> wrote:
>>> >
>>> > Hey list,
>>> >
>>> > I'm running FS on EC2 (I know, I know). Having some issues with random
>>> packet loss, which I believe almost certainly I have narrowed down to timer
>>> issues and/or network latency/jitter (seems surprising since I'm using
>>> c5.xlarge instances).
>>> >
>>> > Behavior is that, during a call, brief pauses or notable audio loss
>>> will occur. This is on high bandwidth links that are otherwise stable.
>>> Freeswitch logs with max debug spew out "Hot Hit 1" through "Hot Hit 10"
>>> and eventually "auto-flush catching up 1 packet(s)" in rapid succession
>>> (usually going through the cycle 4-5 times) before things settle again.
>>> Obviously that means a minimum of 4-5 audio packets were dropped within the
>>> span of a second which results in considerable audio artifacting.
>>> >
>>> > Changing rtp-timer-name to none, which I understand to perform
>>> synchronous reads of RTP audio (as opposed to timer-based async reads)
>>> makes the audio notably smoother. That said, I'm having a hard time
>>> uncovering the consequences of doing this. Obviously I understand that
>>> reads will block the RTP thread, but I can't seem to understand the
>>> potential ramifications of this. Could anyone help clarify?
>>> >
>>> > My other question is: assuming "timer while hot" indicates what I
>>> believe it does (that when the timer hit there was >1 packet in the queue
>>> to be read), couldn't this issue also just be caused by network jitter, and
>>> not necessarily just timer inconsistencies?
>>> >
>>> > Thanks in advance.
>>> >
>>> > Best,
>>> > Colin
>>> >
>>> >
>>> > ____________________________________________________________
>>> _____________
>>> > Professional FreeSWITCH Consulting Services:
>>> > consulting at freeswitch.org
>>> > http://www.freeswitchsolutions.com
>>> >
>>> > Official FreeSWITCH Sites
>>> > http://www.freeswitch.org
>>> > http://confluence.freeswitch.org
>>> > http://www.cluecon.com
>>> >
>>> > FreeSWITCH-users mailing list
>>> > FreeSWITCH-users at lists.freeswitch.org
>>> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/
>>> freeswitch-users
>>> > http://www.freeswitch.org
>>>
>>> ____________________________________________________________
>>> _____________
>>> Professional FreeSWITCH Consulting Services:
>>> consulting at freeswitch.org
>>> http://www.freeswitchsolutions.com
>>>
>>> Official FreeSWITCH Sites
>>> http://www.freeswitch.org
>>> http://confluence.freeswitch.org
>>> http://www.cluecon.com
>>>
>>> FreeSWITCH-users mailing list
>>> FreeSWITCH-users at lists.freeswitch.org
>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>>> http://www.freeswitch.org
>>
>>
>> _________________________________________________________________________
>> Professional FreeSWITCH Consulting Services:
>> consulting at freeswitch.org
>> http://www.freeswitchsolutions.com
>>
>> Official FreeSWITCH Sites
>> http://www.freeswitch.org
>> http://confluence.freeswitch.org
>> http://www.cluecon.com
>>
>> FreeSWITCH-users mailing list
>> FreeSWITCH-users at lists.freeswitch.org
>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
>> http://www.freeswitch.org
>>
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting at freeswitch.org
> http://www.freeswitchsolutions.com
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://confluence.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users at lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.freeswitch.org/pipermail/freeswitch-users/attachments/20180205/4ce75b33/attachment.html>