Problem with rtp streams and stair-stepped (or ramped) increased lag
Having some occasional user reports of problem calls where they are fine, and then something happens on the call and lag increases significantly, sometimes up to 2+ seconds. I've got severe examples on both cisco and polycom phones. What I'm seeing looks like the call is going perfectly for a period of time (sometimes up to a few minutes), and then there is a period of time with higher latency packets, and the overall delay in the graph increases steadily at that point, and never recovers. It sounded like rtp-autoflush-during-bridge might be something relevant, but that's set to the default. Also saw "rtp-rewrite-timestamps", but unclear if that is necessary here. I've got pcap captures of the rtp streams if that'll help any. -- Nathan ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
In one particular stream, which is call mgr <-> FS, the CCM to freeswitch side of the stream shows no issues, but freeswitch to CCM direction shows a number of drifts, some just one ptime worth, others larger. This instance is running as a VM, but allocated significantly more reserved cpu (and very high shares) on a lightly loaded host. Concurrent calls on the FS instance is in the single digits at most at this point. Typical end to end network induced latencies less than 3 ms at most. Any suggestions on what to look at or steps to take here? Certainly not happening on every call, but I do believe I've seen it on both cisco and polycom phone connections. Usually, there is just a slow stairstep over the period of the call. -- Nathan On 06/24/2013 06:24 PM, Nathan Neulinger wrote:
Having some occasional user reports of problem calls where they are fine, and then something happens on the call and lag increases significantly, sometimes up to 2+ seconds.
I've got severe examples on both cisco and polycom phones. What I'm seeing looks like the call is going perfectly for a period of time (sometimes up to a few minutes), and then there is a period of time with higher latency packets, and the overall delay in the graph increases steadily at that point, and never recovers.
It sounded like rtp-autoflush-during-bridge might be something relevant, but that's set to the default. Also saw "rtp-rewrite-timestamps", but unclear if that is necessary here.
I've got pcap captures of the rtp streams if that'll help any.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
I've seen a similar issue on a small network behind a pfsense router. Network diagram is: Hard Phones(3+ Yealink and Polycom mix) -> switch -> PFsense -> Comcast -> FS conferencing server. In my case I was seeing ~10 seconds of RTP delay(tested from doing a/b response testing), but instant sip handling. The audio was in perfect sync coming from the conference server to the 3 endpoints. Nathan, what version of FS are you running? I have not yet ruled out that the issue isn't a local network problem. William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/24/2013 04:40 PM, Nathan Neulinger wrote:
In one particular stream, which is call mgr <-> FS, the CCM to freeswitch side of the stream shows no issues, but freeswitch to CCM direction shows a number of drifts, some just one ptime worth, others larger.
This instance is running as a VM, but allocated significantly more reserved cpu (and very high shares) on a lightly loaded host. Concurrent calls on the FS instance is in the single digits at most at this point. Typical end to end network induced latencies less than 3 ms at most.
Any suggestions on what to look at or steps to take here? Certainly not happening on every call, but I do believe I've seen it on both cisco and polycom phone connections. Usually, there is just a slow stairstep over the period of the call.
-- Nathan
On 06/24/2013 06:24 PM, Nathan Neulinger wrote:
Having some occasional user reports of problem calls where they are fine, and then something happens on the call and lag increases significantly, sometimes up to 2+ seconds.
I've got severe examples on both cisco and polycom phones. What I'm seeing looks like the call is going perfectly for a period of time (sometimes up to a few minutes), and then there is a period of time with higher latency packets, and the overall delay in the graph increases steadily at that point, and never recovers.
It sounded like rtp-autoflush-during-bridge might be something relevant, but that's set to the default. Also saw "rtp-rewrite-timestamps", but unclear if that is necessary here.
I've got pcap captures of the rtp streams if that'll help any.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
This instance is running v1.2stable as of a week or so ago. (In a pilot, so trying not to update it very frequently, but when I add stuff to the skinny code.) The interesting thing is - on MOST calls, it's working fine, and even on the calls that are a problem, it works fine, up until "something" happens, and then it starts building up the delay. Even on non-problem calls, I occasionally see a slow/occasional stairstep that doesn't accumulate much, but on the BAD calls it accumulates to high delays. Example call - graphs from voipmonitor: http://imgur.com/F4S91mr,lAulG2o -- Nathan On 06/24/2013 07:38 PM, William King wrote:
I've seen a similar issue on a small network behind a pfsense router. Network diagram is: Hard Phones(3+ Yealink and Polycom mix) -> switch -> PFsense -> Comcast -> FS conferencing server.
In my case I was seeing ~10 seconds of RTP delay(tested from doing a/b response testing), but instant sip handling. The audio was in perfect sync coming from the conference server to the 3 endpoints.
Nathan, what version of FS are you running?
I have not yet ruled out that the issue isn't a local network problem.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/24/2013 04:40 PM, Nathan Neulinger wrote:
In one particular stream, which is call mgr <-> FS, the CCM to freeswitch side of the stream shows no issues, but freeswitch to CCM direction shows a number of drifts, some just one ptime worth, others larger.
This instance is running as a VM, but allocated significantly more reserved cpu (and very high shares) on a lightly loaded host. Concurrent calls on the FS instance is in the single digits at most at this point. Typical end to end network induced latencies less than 3 ms at most.
Any suggestions on what to look at or steps to take here? Certainly not happening on every call, but I do believe I've seen it on both cisco and polycom phone connections. Usually, there is just a slow stairstep over the period of the call.
-- Nathan
On 06/24/2013 06:24 PM, Nathan Neulinger wrote:
Having some occasional user reports of problem calls where they are fine, and then something happens on the call and lag increases significantly, sometimes up to 2+ seconds.
I've got severe examples on both cisco and polycom phones. What I'm seeing looks like the call is going perfectly for a period of time (sometimes up to a few minutes), and then there is a period of time with higher latency packets, and the overall delay in the graph increases steadily at that point, and never recovers.
It sounded like rtp-autoflush-during-bridge might be something relevant, but that's set to the default. Also saw "rtp-rewrite-timestamps", but unclear if that is necessary here.
I've got pcap captures of the rtp streams if that'll help any.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
fsctl debug_level 10 Also make sure ve host has high res timing. On Jun 24, 2013 8:06 PM, "Nathan Neulinger" <nneul@mst.edu> wrote:
This instance is running v1.2stable as of a week or so ago. (In a pilot, so trying not to update it very frequently, but when I add stuff to the skinny code.)
The interesting thing is - on MOST calls, it's working fine, and even on the calls that are a problem, it works fine, up until "something" happens, and then it starts building up the delay.
Even on non-problem calls, I occasionally see a slow/occasional stairstep that doesn't accumulate much, but on the BAD calls it accumulates to high delays.
Example call - graphs from voipmonitor:
http://imgur.com/F4S91mr,lAulG2o
-- Nathan
On 06/24/2013 07:38 PM, William King wrote:
I've seen a similar issue on a small network behind a pfsense router. Network diagram is: Hard Phones(3+ Yealink and Polycom mix) -> switch -> PFsense -> Comcast -> FS conferencing server.
In my case I was seeing ~10 seconds of RTP delay(tested from doing a/b response testing), but instant sip handling. The audio was in perfect sync coming from the conference server to the 3 endpoints.
Nathan, what version of FS are you running?
I have not yet ruled out that the issue isn't a local network problem.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/24/2013 04:40 PM, Nathan Neulinger wrote:
In one particular stream, which is call mgr <-> FS, the CCM to freeswitch side of the stream shows no issues, but freeswitch to CCM direction shows a number of drifts, some just one ptime worth, others larger.
This instance is running as a VM, but allocated significantly more reserved cpu (and very high shares) on a lightly loaded host. Concurrent calls on the FS instance is in the single digits at most at this point. Typical end to end network induced latencies less than 3 ms at most.
Any suggestions on what to look at or steps to take here? Certainly not happening on every call, but I do believe I've seen it on both cisco and polycom phone connections. Usually, there is just a slow stairstep over the period of the call.
-- Nathan
On 06/24/2013 06:24 PM, Nathan Neulinger wrote:
Having some occasional user reports of problem calls where they are fine, and then something happens on the call and lag increases significantly, sometimes up to 2+ seconds.
I've got severe examples on both cisco and polycom phones. What I'm seeing looks like the call is going perfectly for a period of time (sometimes up to a few minutes), and then there is a period of time with higher latency packets, and the overall delay in the graph increases steadily at that point, and never recovers.
It sounded like rtp-autoflush-during-bridge might be something relevant, but that's set to the default. Also saw "rtp-rewrite-timestamps", but unclear if that is necessary here.
I've got pcap captures of the rtp streams if that'll help any.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 06/24/2013 08:24 PM, Anthony Minessale wrote:
fsctl debug_level 10 Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence. Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest. /dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture. -- Nathan ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer<http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This *seemed *to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that. Probably the wrong solution, but all I had time/understanding for. -Avi On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote:
fsctl debug_level 10 Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I guess the big question is this: Is it _supposed_ to recover? From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues. What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging. I don't know where my latency is being introduced unfortunately... -- Nathan On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
Nathan, I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone. Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue. William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition. In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones. Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though. -- Nathan On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
What are you using to analyze the rtp streams? Wireshark? or voipmonitor? William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Both... Graphs are from voipmonitor, but the wide shifts in delay are very visible when processing the stream in wireshark. -- Nathan On 06/25/2013 07:35 PM, William King wrote:
What are you using to analyze the rtp streams? Wireshark? or voipmonitor?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
You mentioned you were using VMWare to run FS in a virtual setup. What's the OS and the physical NIC on the host box? I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC. William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/25/2013 05:36 PM, Nathan Neulinger wrote:
Both... Graphs are from voipmonitor, but the wide shifts in delay are very visible when processing the stream in wireshark.
-- Nathan
On 06/25/2013 07:35 PM, William King wrote:
What are you using to analyze the rtp streams? Wireshark? or voipmonitor?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
It's a cluster of several vmware ESXi 5.1 EntPlus on a Dell R710 with both BCM5709 and Intel 10G cards. -- Nathan On 06/25/2013 07:55 PM, William King wrote:
You mentioned you were using VMWare to run FS in a virtual setup. What's the OS and the physical NIC on the host box?
I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:36 PM, Nathan Neulinger wrote:
Both... Graphs are from voipmonitor, but the wide shifts in delay are very visible when processing the stream in wireshark.
-- Nathan
On 06/25/2013 07:35 PM, William King wrote:
What are you using to analyze the rtp streams? Wireshark? or voipmonitor?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote: > It sounds like I saw this on a home internet connection to a public > server when the connection had varying latency. > Once the call jittered, it never recovered. > My stop-gap was to add a small jitter buffer > <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action > application="jitterbuffer" data="100:200:20"/> to the user dialplan. > This /seemed /to make FS handle rewriting the timestamps for drift > rather than relying on the Linksys ATA to do that. > > Probably the wrong solution, but all I had time/understanding for. > -Avi > > > On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu > <mailto:nneul@mst.edu>> wrote: > > > > On 06/24/2013 08:24 PM, Anthony Minessale wrote: > > fsctl debug_level 10 > > Also make sure ve host has high res timing. > > Turned up logging, will wait for next occurrence. > > Not sure on the latter - it's a vmware ESXi 5.1 box running FC > 17 x86_64 as the guest. > > /dev/rtc /dev/rtc0 exist > posix and soft timers are loaded in fs > > I've got a bunch of unused Dell 1950's on hand, so could use a > few of those machines if needed to get vmware out of the > picture. > > -- Nathan > > ------------------------------------------------------------ > Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> > Missouri S&T Information Technology (573) 612-1412 > <tel:%28573%29%20612-1412> > System Administrator - Architect > > > _________________________________________________________________________ > > > Professional FreeSWITCH Consulting Services: > consulting@freeswitch.org <mailto:consulting@freeswitch.org> > http://www.freeswitchsolutions.com > > FreeSWITCH-powered IP PBX: The CudaTel Communication Server > http://www.cudatel.com > > Official FreeSWITCH Sites > http://www.freeswitch.org > http://wiki.freeswitch.org > http://www.cluecon.com > > FreeSWITCH-users mailing list > FreeSWITCH-users@lists.freeswitch.org > <mailto:FreeSWITCH-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > > > http://www.freeswitch.org > >
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
Got everything moved to real hardware... still seeing an issue with stair stepping. Hardware is a Dell 1950 with dual dual or dual quad xeons. I've got the debug level turned up on the boxes again and am capturing a call. The test case where I saw the stair stepping was: PolyCom 550 -> FS -> PolyCom 350 All local network w/ < 1ms typically. Just connected from one to the other and left them connected for a half hour. Over the call, delay drift increased to 80 ms it looked like. Now, that's not one of the problem calls, still waiting to see if I see any of those while running on real hardware. This test case is on master from within past few days. -- Nathan On 06/25/2013 07:55 PM, William King wrote:
You mentioned you were using VMWare to run FS in a virtual setup. What's the OS and the physical NIC on the host box?
I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:36 PM, Nathan Neulinger wrote:
Both... Graphs are from voipmonitor, but the wide shifts in delay are very visible when processing the stream in wireshark.
-- Nathan
On 06/25/2013 07:35 PM, William King wrote:
What are you using to analyze the rtp streams? Wireshark? or voipmonitor?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote: > It sounds like I saw this on a home internet connection to a public > server when the connection had varying latency. > Once the call jittered, it never recovered. > My stop-gap was to add a small jitter buffer > <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action > application="jitterbuffer" data="100:200:20"/> to the user dialplan. > This /seemed /to make FS handle rewriting the timestamps for drift > rather than relying on the Linksys ATA to do that. > > Probably the wrong solution, but all I had time/understanding for. > -Avi > > > On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu > <mailto:nneul@mst.edu>> wrote: > > > > On 06/24/2013 08:24 PM, Anthony Minessale wrote: > > fsctl debug_level 10 > > Also make sure ve host has high res timing. > > Turned up logging, will wait for next occurrence. > > Not sure on the latter - it's a vmware ESXi 5.1 box running FC > 17 x86_64 as the guest. > > /dev/rtc /dev/rtc0 exist > posix and soft timers are loaded in fs > > I've got a bunch of unused Dell 1950's on hand, so could use a > few of those machines if needed to get vmware out of the > picture. > > -- Nathan > > ------------------------------------------------------------ > Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> > Missouri S&T Information Technology (573) 612-1412 > <tel:%28573%29%20612-1412> > System Administrator - Architect > > > _________________________________________________________________________ > > > Professional FreeSWITCH Consulting Services: > consulting@freeswitch.org <mailto:consulting@freeswitch.org> > http://www.freeswitchsolutions.com > > FreeSWITCH-powered IP PBX: The CudaTel Communication Server > http://www.cudatel.com > > Official FreeSWITCH Sites > http://www.freeswitch.org > http://wiki.freeswitch.org > http://www.cluecon.com > > FreeSWITCH-users mailing list > FreeSWITCH-users@lists.freeswitch.org > <mailto:FreeSWITCH-users@lists.freeswitch.org> > http://lists.freeswitch.org/mailman/listinfo/freeswitch-users > > UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users > > > http://www.freeswitch.org > >
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
While a useful tool, You can't 100% rely on wireshark to report delay, it fails to properly deal with things such as mark bits clearing the buffer etc and you have to trust it's clock to be accurate too. You should back it up with audio tests, call yourself and talk into it and measure for latency as well, also looking at pcap of both ends of the call using the inbound ts vs the outbound. Another control you should use is to try sip 2 sip. It's possible that the skinny is lacking some of the RTP flags that other channels use that help reduce latency. On Wed, Jun 26, 2013 at 11:09 AM, Nathan Neulinger <nneul@mst.edu> wrote:
Got everything moved to real hardware... still seeing an issue with stair stepping.
Hardware is a Dell 1950 with dual dual or dual quad xeons.
I've got the debug level turned up on the boxes again and am capturing a call.
The test case where I saw the stair stepping was:
PolyCom 550 -> FS -> PolyCom 350 All local network w/ < 1ms typically.
Just connected from one to the other and left them connected for a half hour. Over the call, delay drift increased to 80 ms it looked like. Now, that's not one of the problem calls, still waiting to see if I see any of those while running on real hardware.
This test case is on master from within past few days.
-- Nathan
On 06/25/2013 07:55 PM, William King wrote:
You mentioned you were using VMWare to run FS in a virtual setup. What's the OS and the physical NIC on the host box?
I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:36 PM, Nathan Neulinger wrote:
Both... Graphs are from voipmonitor, but the wide shifts in delay are very visible when processing the stream in wireshark.
-- Nathan
On 06/25/2013 07:35 PM, William King wrote:
What are you using to analyze the rtp streams? Wireshark? or voipmonitor?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:19 PM, Nathan Neulinger wrote:
Very interesting... look forward to seeing the comparison of those two captures... I'm in the process of trying to rule out vmware as a contributing factor by moving the FS servers to dedicated hardware, but your description sounds like there may be some other issue in addition.
In my case, it's all confined within local network, so there shouldn't be much of any latency spikes, at least not significant ones.
Looking at the graphs of a few calls today, on at least one of the not-so-bad ones, I saw a very periodic blip on the stairstep every 60 seconds. That doesn't cover the large drift ones in the graphs I posted though.
-- Nathan
On 06/25/2013 06:48 PM, William King wrote:
Nathan,
I had a chance to diagnose the issue live on a system today. While I'm not yet sure we are hitting the same issue, I'm now confident the problem I'm hitting is not FS related, but looks to be kernel related. I was able to get multiple calls up all with large 5+ second delays. Restarting the calls did nothing to clear the problem. Restarting Freeswitch repeatedly also had no effect. Upon restarting the box, the problem was gone.
Also in my diagnostics I've found that it isn't all UDP packets that are effected. I now have a switch mirroring the port and a pcap running locally on the machine. I'll see tomorrow if it's just a matter of an inbound or outbound network stack buffer(or network stack priority) issue.
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/25/2013 05:13 AM, Nathan Neulinger wrote: > I guess the big question is this: > > Is it _supposed_ to recover? > > From Tony's notes, it's sounding like it's very critically > dependent on the timer in the switch, which very well be the > current cause of my issues. > > What I probably need to do is have a pair of phones automatically > calling each other, and just leaving them up - just to > generate a continuous independent background stream. That'll tell me > if any glitches are specific to a particular > channel, or if they are common across multiple calls - which I'd > expect if the timer was swinging. > > I don't know where my latency is being introduced unfortunately... > > -- Nathan > > On 06/25/2013 01:59 AM, Avi Marcus wrote: >> It sounds like I saw this on a home internet connection to a public >> server when the connection had varying latency. >> Once the call jittered, it never recovered. >> My stop-gap was to add a small jitter buffer >> <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action >> application="jitterbuffer" data="100:200:20"/> to the user dialplan. >> This /seemed /to make FS handle rewriting the timestamps for drift >> rather than relying on the Linksys ATA to do that. >> >> Probably the wrong solution, but all I had time/understanding for. >> -Avi >> >> >> On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu >> <mailto:nneul@mst.edu>> wrote: >> >> >> >> On 06/24/2013 08:24 PM, Anthony Minessale wrote: >> > fsctl debug_level 10 >> > Also make sure ve host has high res timing. >> >> Turned up logging, will wait for next occurrence. >> >> Not sure on the latter - it's a vmware ESXi 5.1 box running FC >> 17 x86_64 as the guest. >> >> /dev/rtc /dev/rtc0 exist >> posix and soft timers are loaded in fs >> >> I've got a bunch of unused Dell 1950's on hand, so could use a >> few of those machines if needed to get vmware out of the >> picture. >> >> -- Nathan >> >> ------------------------------------------------------------ >> Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> >> Missouri S&T Information Technology (573) 612-1412 >> <tel:%28573%29%20612-1412> >> System Administrator - Architect >> >> >>
>> >> >> Professional FreeSWITCH Consulting Services: >> consulting@freeswitch.org <mailto:consulting@freeswitch.org
>> http://www.freeswitchsolutions.com >> >> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >> http://www.cudatel.com >> >> Official FreeSWITCH Sites >> http://www.freeswitch.org >> http://wiki.freeswitch.org >> http://www.cluecon.com >> >> FreeSWITCH-users mailing list >> FreeSWITCH-users@lists.freeswitch.org >> <mailto:FreeSWITCH-users@lists.freeswitch.org> >> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >> >> UNSUBSCRIBE: http://lists.freeswitch.org/mailman/options/freeswitch-users >> >> >> http://www.freeswitch.org >> >> >
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire AIM: anthm MSN:anthony_minessale@hotmail.com GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com IRC: irc.freenode.net #freeswitch FreeSWITCH Developer Conference sip:888@conference.freeswitch.org googletalk:conf+888@conference.freeswitch.org pstn:+19193869900
Do the same caveats apply to voipmonitor? The graphs from voipmonitor are showing very clear stair stepping. This most recent test was 100% SIP, no skinny involved. At the moment, I'm waiting for any additional reports of the "bad" calls - i.e. the one that jumps to 2000+ ms. I haven't seen any of those yet on the real hardware, only the slow climb case. These are the two graphs on voipmonitor for the test call between two phones on my desk left sitting there for 40 minutes: http://i.imgur.com/3kx5q8z.png http://i.imgur.com/pj2cMN7.png -- Nathan On 06/26/2013 12:08 PM, Anthony Minessale wrote:
While a useful tool, You can't 100% rely on wireshark to report delay, it fails to properly deal with things such as mark bits clearing the buffer etc and you have to trust it's clock to be accurate too.
You should back it up with audio tests, call yourself and talk into it and measure for latency as well, also looking at pcap of both ends of the call using the inbound ts vs the outbound.
Another control you should use is to try sip 2 sip. It's possible that the skinny is lacking some of the RTP flags that other channels use that help reduce latency.
On Wed, Jun 26, 2013 at 11:09 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
Got everything moved to real hardware... still seeing an issue with stair stepping.
Hardware is a Dell 1950 with dual dual or dual quad xeons.
I've got the debug level turned up on the boxes again and am capturing a call.
The test case where I saw the stair stepping was:
PolyCom 550 -> FS -> PolyCom 350 All local network w/ < 1ms typically.
Just connected from one to the other and left them connected for a half hour. Over the call, delay drift increased to 80 ms it looked like. Now, that's not one of the problem calls, still waiting to see if I see any of those while running on real hardware.
This test case is on master from within past few days.
-- Nathan
On 06/25/2013 07:55 PM, William King wrote: > You mentioned you were using VMWare to run FS in a virtual setup. What's > the OS and the physical NIC on the host box? > > I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC. > > William King > Senior Engineer > Quentus Technologies, INC > 1037 NE 65th St Suite 273 > Seattle, WA 98115 > Main: (877) 211-9337 > Office: (206) 388-4772 > Cell: (253) 686-5518 > william.king@quentustech.com <mailto:william.king@quentustech.com> > > On 06/25/2013 05:36 PM, Nathan Neulinger wrote: >> Both... Graphs are from voipmonitor, but the wide shifts in delay are >> very visible when processing the stream in wireshark. >> >> -- Nathan >> >> On 06/25/2013 07:35 PM, William King wrote: >>> What are you using to analyze the rtp streams? Wireshark? or voipmonitor? >>> >>> William King >>> Senior Engineer >>> Quentus Technologies, INC >>> 1037 NE 65th St Suite 273 >>> Seattle, WA 98115 >>> Main: (877) 211-9337 >>> Office: (206) 388-4772 >>> Cell: (253) 686-5518 >>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>> >>> On 06/25/2013 05:19 PM, Nathan Neulinger wrote: >>>> Very interesting... look forward to seeing the comparison of those two >>>> captures... I'm in the process of trying to rule out vmware as a >>>> contributing factor by moving the FS servers to dedicated hardware, but >>>> your description sounds like there may be some other issue in addition. >>>> >>>> In my case, it's all confined within local network, so there shouldn't >>>> be much of any latency spikes, at least not significant ones. >>>> >>>> Looking at the graphs of a few calls today, on at least one of the >>>> not-so-bad ones, I saw a very periodic blip on the stairstep every 60 >>>> seconds. That doesn't cover the large drift ones in the graphs I posted >>>> though. >>>> >>>> -- Nathan >>>> >>>> On 06/25/2013 06:48 PM, William King wrote: >>>>> Nathan, >>>>> >>>>> I had a chance to diagnose the issue live on a system today. While I'm >>>>> not yet sure we are hitting the same issue, I'm now confident the >>>>> problem I'm hitting is not FS related, but looks to be kernel >>>>> related. I >>>>> was able to get multiple calls up all with large 5+ second delays. >>>>> Restarting the calls did nothing to clear the problem. Restarting >>>>> Freeswitch repeatedly also had no effect. Upon restarting the box, the >>>>> problem was gone. >>>>> >>>>> Also in my diagnostics I've found that it isn't all UDP packets that >>>>> are >>>>> effected. I now have a switch mirroring the port and a pcap running >>>>> locally on the machine. I'll see tomorrow if it's just a matter of an >>>>> inbound or outbound network stack buffer(or network stack priority) >>>>> issue. >>>>> >>>>> William King >>>>> Senior Engineer >>>>> Quentus Technologies, INC >>>>> 1037 NE 65th St Suite 273 >>>>> Seattle, WA 98115 >>>>> Main: (877) 211-9337 >>>>> Office: (206) 388-4772 >>>>> Cell: (253) 686-5518 >>>>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>>>> >>>>> On 06/25/2013 05:13 AM, Nathan Neulinger wrote: >>>>>> I guess the big question is this: >>>>>> >>>>>> Is it _supposed_ to recover? >>>>>> >>>>>> From Tony's notes, it's sounding like it's very critically >>>>>> dependent on the timer in the switch, which very well be the >>>>>> current cause of my issues. >>>>>> >>>>>> What I probably need to do is have a pair of phones automatically >>>>>> calling each other, and just leaving them up - just to >>>>>> generate a continuous independent background stream. That'll tell me >>>>>> if any glitches are specific to a particular >>>>>> channel, or if they are common across multiple calls - which I'd >>>>>> expect if the timer was swinging. >>>>>> >>>>>> I don't know where my latency is being introduced unfortunately... >>>>>> >>>>>> -- Nathan >>>>>> >>>>>> On 06/25/2013 01:59 AM, Avi Marcus wrote: >>>>>>> It sounds like I saw this on a home internet connection to a public >>>>>>> server when the connection had varying latency. >>>>>>> Once the call jittered, it never recovered. >>>>>>> My stop-gap was to add a small jitter buffer >>>>>>> <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action >>>>>>> application="jitterbuffer" data="100:200:20"/> to the user dialplan. >>>>>>> This /seemed /to make FS handle rewriting the timestamps for drift >>>>>>> rather than relying on the Linksys ATA to do that. >>>>>>> >>>>>>> Probably the wrong solution, but all I had time/understanding for. >>>>>>> -Avi >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu> >>>>>>> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>>> wrote: >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 06/24/2013 08:24 PM, Anthony Minessale wrote: >>>>>>> > fsctl debug_level 10 >>>>>>> > Also make sure ve host has high res timing. >>>>>>> >>>>>>> Turned up logging, will wait for next occurrence. >>>>>>> >>>>>>> Not sure on the latter - it's a vmware ESXi 5.1 box running FC >>>>>>> 17 x86_64 as the guest. >>>>>>> >>>>>>> /dev/rtc /dev/rtc0 exist >>>>>>> posix and soft timers are loaded in fs >>>>>>> >>>>>>> I've got a bunch of unused Dell 1950's on hand, so could use a >>>>>>> few of those machines if needed to get vmware out of the >>>>>>> picture. >>>>>>> >>>>>>> -- Nathan >>>>>>> >>>>>>> ------------------------------------------------------------ >>>>>>> Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>> >>>>>>> Missouri S&T Information Technology (573) 612-1412 >>>>>>> <tel:%28573%29%20612-1412> >>>>>>> System Administrator - Architect >>>>>>> >>>>>>> >>>>>>> _________________________________________________________________________ >>>>>>> >>>>>>> >>>>>>> Professional FreeSWITCH Consulting Services: >>>>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> <mailto:consulting@freeswitch.org <mailto:consulting@freeswitch.org>> >>>>>>> http://www.freeswitchsolutions.com >>>>>>> >>>>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>>>> http://www.cudatel.com >>>>>>> >>>>>>> Official FreeSWITCH Sites >>>>>>> http://www.freeswitch.org >>>>>>> http://wiki.freeswitch.org >>>>>>> http://www.cluecon.com >>>>>>> >>>>>>> FreeSWITCH-users mailing list >>>>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>>>> <mailto:FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org>> >>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>>>> >>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>>>> >>>>>>> >>>>>>> http://www.freeswitch.org >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> _________________________________________________________________________ >>>>> >>>>> Professional FreeSWITCH Consulting Services: >>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> >>>>> http://www.freeswitchsolutions.com >>>>> >>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>> http://www.cudatel.com >>>>> >>>>> Official FreeSWITCH Sites >>>>> http://www.freeswitch.org >>>>> http://wiki.freeswitch.org >>>>> http://www.cluecon.com >>>>> >>>>> FreeSWITCH-users mailing list >>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>> >>>>> http://www.freeswitch.org >>>>> >>>> >>
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:+19193869900
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
How many cores did your VM have assigned to it? And how many concurrent calls did you have up at the time? William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/26/2013 11:47 AM, Nathan Neulinger wrote:
Do the same caveats apply to voipmonitor? The graphs from voipmonitor are showing very clear stair stepping.
This most recent test was 100% SIP, no skinny involved.
At the moment, I'm waiting for any additional reports of the "bad" calls - i.e. the one that jumps to 2000+ ms. I haven't seen any of those yet on the real hardware, only the slow climb case.
These are the two graphs on voipmonitor for the test call between two phones on my desk left sitting there for 40 minutes:
http://i.imgur.com/3kx5q8z.png
http://i.imgur.com/pj2cMN7.png
-- Nathan
On 06/26/2013 12:08 PM, Anthony Minessale wrote:
While a useful tool, You can't 100% rely on wireshark to report delay, it fails to properly deal with things such as mark bits clearing the buffer etc and you have to trust it's clock to be accurate too.
You should back it up with audio tests, call yourself and talk into it and measure for latency as well, also looking at pcap of both ends of the call using the inbound ts vs the outbound.
Another control you should use is to try sip 2 sip. It's possible that the skinny is lacking some of the RTP flags that other channels use that help reduce latency.
On Wed, Jun 26, 2013 at 11:09 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
Got everything moved to real hardware... still seeing an issue with stair stepping.
Hardware is a Dell 1950 with dual dual or dual quad xeons.
I've got the debug level turned up on the boxes again and am capturing a call.
The test case where I saw the stair stepping was:
PolyCom 550 -> FS -> PolyCom 350 All local network w/ < 1ms typically.
Just connected from one to the other and left them connected for a half hour. Over the call, delay drift increased to 80 ms it looked like. Now, that's not one of the problem calls, still waiting to see if I see any of those while running on real hardware.
This test case is on master from within past few days.
-- Nathan
On 06/25/2013 07:55 PM, William King wrote: > You mentioned you were using VMWare to run FS in a virtual setup. What's > the OS and the physical NIC on the host box? > > I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC. > > William King > Senior Engineer > Quentus Technologies, INC > 1037 NE 65th St Suite 273 > Seattle, WA 98115 > Main: (877) 211-9337 > Office: (206) 388-4772 > Cell: (253) 686-5518 > william.king@quentustech.com <mailto:william.king@quentustech.com> > > On 06/25/2013 05:36 PM, Nathan Neulinger wrote: >> Both... Graphs are from voipmonitor, but the wide shifts in delay are >> very visible when processing the stream in wireshark. >> >> -- Nathan >> >> On 06/25/2013 07:35 PM, William King wrote: >>> What are you using to analyze the rtp streams? Wireshark? or voipmonitor? >>> >>> William King >>> Senior Engineer >>> Quentus Technologies, INC >>> 1037 NE 65th St Suite 273 >>> Seattle, WA 98115 >>> Main: (877) 211-9337 >>> Office: (206) 388-4772 >>> Cell: (253) 686-5518 >>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>> >>> On 06/25/2013 05:19 PM, Nathan Neulinger wrote: >>>> Very interesting... look forward to seeing the comparison of those two >>>> captures... I'm in the process of trying to rule out vmware as a >>>> contributing factor by moving the FS servers to dedicated hardware, but >>>> your description sounds like there may be some other issue in addition. >>>> >>>> In my case, it's all confined within local network, so there shouldn't >>>> be much of any latency spikes, at least not significant ones. >>>> >>>> Looking at the graphs of a few calls today, on at least one of the >>>> not-so-bad ones, I saw a very periodic blip on the stairstep every 60 >>>> seconds. That doesn't cover the large drift ones in the graphs I posted >>>> though. >>>> >>>> -- Nathan >>>> >>>> On 06/25/2013 06:48 PM, William King wrote: >>>>> Nathan, >>>>> >>>>> I had a chance to diagnose the issue live on a system today. While I'm >>>>> not yet sure we are hitting the same issue, I'm now confident the >>>>> problem I'm hitting is not FS related, but looks to be kernel >>>>> related. I >>>>> was able to get multiple calls up all with large 5+ second delays. >>>>> Restarting the calls did nothing to clear the problem. Restarting >>>>> Freeswitch repeatedly also had no effect. Upon restarting the box, the >>>>> problem was gone. >>>>> >>>>> Also in my diagnostics I've found that it isn't all UDP packets that >>>>> are >>>>> effected. I now have a switch mirroring the port and a pcap running >>>>> locally on the machine. I'll see tomorrow if it's just a matter of an >>>>> inbound or outbound network stack buffer(or network stack priority) >>>>> issue. >>>>> >>>>> William King >>>>> Senior Engineer >>>>> Quentus Technologies, INC >>>>> 1037 NE 65th St Suite 273 >>>>> Seattle, WA 98115 >>>>> Main: (877) 211-9337 >>>>> Office: (206) 388-4772 >>>>> Cell: (253) 686-5518 >>>>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>>>> >>>>> On 06/25/2013 05:13 AM, Nathan Neulinger wrote: >>>>>> I guess the big question is this: >>>>>> >>>>>> Is it _supposed_ to recover? >>>>>> >>>>>> From Tony's notes, it's sounding like it's very critically >>>>>> dependent on the timer in the switch, which very well be the >>>>>> current cause of my issues. >>>>>> >>>>>> What I probably need to do is have a pair of phones automatically >>>>>> calling each other, and just leaving them up - just to >>>>>> generate a continuous independent background stream. That'll tell me >>>>>> if any glitches are specific to a particular >>>>>> channel, or if they are common across multiple calls - which I'd >>>>>> expect if the timer was swinging. >>>>>> >>>>>> I don't know where my latency is being introduced unfortunately... >>>>>> >>>>>> -- Nathan >>>>>> >>>>>> On 06/25/2013 01:59 AM, Avi Marcus wrote: >>>>>>> It sounds like I saw this on a home internet connection to a public >>>>>>> server when the connection had varying latency. >>>>>>> Once the call jittered, it never recovered. >>>>>>> My stop-gap was to add a small jitter buffer >>>>>>> <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action >>>>>>> application="jitterbuffer" data="100:200:20"/> to the user dialplan. >>>>>>> This /seemed /to make FS handle rewriting the timestamps for drift >>>>>>> rather than relying on the Linksys ATA to do that. >>>>>>> >>>>>>> Probably the wrong solution, but all I had time/understanding for. >>>>>>> -Avi >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu> >>>>>>> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>>> wrote: >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 06/24/2013 08:24 PM, Anthony Minessale wrote: >>>>>>> > fsctl debug_level 10 >>>>>>> > Also make sure ve host has high res timing. >>>>>>> >>>>>>> Turned up logging, will wait for next occurrence. >>>>>>> >>>>>>> Not sure on the latter - it's a vmware ESXi 5.1 box running FC >>>>>>> 17 x86_64 as the guest. >>>>>>> >>>>>>> /dev/rtc /dev/rtc0 exist >>>>>>> posix and soft timers are loaded in fs >>>>>>> >>>>>>> I've got a bunch of unused Dell 1950's on hand, so could use a >>>>>>> few of those machines if needed to get vmware out of the >>>>>>> picture. >>>>>>> >>>>>>> -- Nathan >>>>>>> >>>>>>> ------------------------------------------------------------ >>>>>>> Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>> >>>>>>> Missouri S&T Information Technology (573) 612-1412 >>>>>>> <tel:%28573%29%20612-1412> >>>>>>> System Administrator - Architect >>>>>>> >>>>>>> >>>>>>> _________________________________________________________________________ >>>>>>> >>>>>>> >>>>>>> Professional FreeSWITCH Consulting Services: >>>>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> <mailto:consulting@freeswitch.org <mailto:consulting@freeswitch.org>> >>>>>>> http://www.freeswitchsolutions.com >>>>>>> >>>>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>>>> http://www.cudatel.com >>>>>>> >>>>>>> Official FreeSWITCH Sites >>>>>>> http://www.freeswitch.org >>>>>>> http://wiki.freeswitch.org >>>>>>> http://www.cluecon.com >>>>>>> >>>>>>> FreeSWITCH-users mailing list >>>>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>>>> <mailto:FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org>> >>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>>>> >>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>>>> >>>>>>> >>>>>>> http://www.freeswitch.org >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> _________________________________________________________________________ >>>>> >>>>> Professional FreeSWITCH Consulting Services: >>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> >>>>> http://www.freeswitchsolutions.com >>>>> >>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>> http://www.cudatel.com >>>>> >>>>> Official FreeSWITCH Sites >>>>> http://www.freeswitch.org >>>>> http://wiki.freeswitch.org >>>>> http://www.cluecon.com >>>>> >>>>> FreeSWITCH-users mailing list >>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>> >>>>> http://www.freeswitch.org >>>>> >>>> >>
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:+19193869900
I think I gave it either 2 or 4 cores... On the test instance, most likely 1 or 2 calls including the test one. It's not a loading issue as near as I can tell - at least not the slow stairstep one. -- Nathan On 06/27/2013 09:24 AM, William King wrote:
How many cores did your VM have assigned to it? And how many concurrent calls did you have up at the time?
William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com
On 06/26/2013 11:47 AM, Nathan Neulinger wrote:
Do the same caveats apply to voipmonitor? The graphs from voipmonitor are showing very clear stair stepping.
This most recent test was 100% SIP, no skinny involved.
At the moment, I'm waiting for any additional reports of the "bad" calls - i.e. the one that jumps to 2000+ ms. I haven't seen any of those yet on the real hardware, only the slow climb case.
These are the two graphs on voipmonitor for the test call between two phones on my desk left sitting there for 40 minutes:
http://i.imgur.com/3kx5q8z.png
http://i.imgur.com/pj2cMN7.png
-- Nathan
On 06/26/2013 12:08 PM, Anthony Minessale wrote:
While a useful tool, You can't 100% rely on wireshark to report delay, it fails to properly deal with things such as mark bits clearing the buffer etc and you have to trust it's clock to be accurate too.
You should back it up with audio tests, call yourself and talk into it and measure for latency as well, also looking at pcap of both ends of the call using the inbound ts vs the outbound.
Another control you should use is to try sip 2 sip. It's possible that the skinny is lacking some of the RTP flags that other channels use that help reduce latency.
On Wed, Jun 26, 2013 at 11:09 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
Got everything moved to real hardware... still seeing an issue with stair stepping.
Hardware is a Dell 1950 with dual dual or dual quad xeons.
I've got the debug level turned up on the boxes again and am capturing a call.
The test case where I saw the stair stepping was:
PolyCom 550 -> FS -> PolyCom 350 All local network w/ < 1ms typically.
Just connected from one to the other and left them connected for a half hour. Over the call, delay drift increased to 80 ms it looked like. Now, that's not one of the problem calls, still waiting to see if I see any of those while running on real hardware.
This test case is on master from within past few days.
-- Nathan
On 06/25/2013 07:55 PM, William King wrote: > You mentioned you were using VMWare to run FS in a virtual setup. What's > the OS and the physical NIC on the host box? > > I'm using Linux kernel 3.2 with RTL8111/8168B chipset for the NIC. > > William King > Senior Engineer > Quentus Technologies, INC > 1037 NE 65th St Suite 273 > Seattle, WA 98115 > Main: (877) 211-9337 > Office: (206) 388-4772 > Cell: (253) 686-5518 > william.king@quentustech.com <mailto:william.king@quentustech.com> > > On 06/25/2013 05:36 PM, Nathan Neulinger wrote: >> Both... Graphs are from voipmonitor, but the wide shifts in delay are >> very visible when processing the stream in wireshark. >> >> -- Nathan >> >> On 06/25/2013 07:35 PM, William King wrote: >>> What are you using to analyze the rtp streams? Wireshark? or voipmonitor? >>> >>> William King >>> Senior Engineer >>> Quentus Technologies, INC >>> 1037 NE 65th St Suite 273 >>> Seattle, WA 98115 >>> Main: (877) 211-9337 >>> Office: (206) 388-4772 >>> Cell: (253) 686-5518 >>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>> >>> On 06/25/2013 05:19 PM, Nathan Neulinger wrote: >>>> Very interesting... look forward to seeing the comparison of those two >>>> captures... I'm in the process of trying to rule out vmware as a >>>> contributing factor by moving the FS servers to dedicated hardware, but >>>> your description sounds like there may be some other issue in addition. >>>> >>>> In my case, it's all confined within local network, so there shouldn't >>>> be much of any latency spikes, at least not significant ones. >>>> >>>> Looking at the graphs of a few calls today, on at least one of the >>>> not-so-bad ones, I saw a very periodic blip on the stairstep every 60 >>>> seconds. That doesn't cover the large drift ones in the graphs I posted >>>> though. >>>> >>>> -- Nathan >>>> >>>> On 06/25/2013 06:48 PM, William King wrote: >>>>> Nathan, >>>>> >>>>> I had a chance to diagnose the issue live on a system today. While I'm >>>>> not yet sure we are hitting the same issue, I'm now confident the >>>>> problem I'm hitting is not FS related, but looks to be kernel >>>>> related. I >>>>> was able to get multiple calls up all with large 5+ second delays. >>>>> Restarting the calls did nothing to clear the problem. Restarting >>>>> Freeswitch repeatedly also had no effect. Upon restarting the box, the >>>>> problem was gone. >>>>> >>>>> Also in my diagnostics I've found that it isn't all UDP packets that >>>>> are >>>>> effected. I now have a switch mirroring the port and a pcap running >>>>> locally on the machine. I'll see tomorrow if it's just a matter of an >>>>> inbound or outbound network stack buffer(or network stack priority) >>>>> issue. >>>>> >>>>> William King >>>>> Senior Engineer >>>>> Quentus Technologies, INC >>>>> 1037 NE 65th St Suite 273 >>>>> Seattle, WA 98115 >>>>> Main: (877) 211-9337 >>>>> Office: (206) 388-4772 >>>>> Cell: (253) 686-5518 >>>>> william.king@quentustech.com <mailto:william.king@quentustech.com> >>>>> >>>>> On 06/25/2013 05:13 AM, Nathan Neulinger wrote: >>>>>> I guess the big question is this: >>>>>> >>>>>> Is it _supposed_ to recover? >>>>>> >>>>>> From Tony's notes, it's sounding like it's very critically >>>>>> dependent on the timer in the switch, which very well be the >>>>>> current cause of my issues. >>>>>> >>>>>> What I probably need to do is have a pair of phones automatically >>>>>> calling each other, and just leaving them up - just to >>>>>> generate a continuous independent background stream. That'll tell me >>>>>> if any glitches are specific to a particular >>>>>> channel, or if they are common across multiple calls - which I'd >>>>>> expect if the timer was swinging. >>>>>> >>>>>> I don't know where my latency is being introduced unfortunately... >>>>>> >>>>>> -- Nathan >>>>>> >>>>>> On 06/25/2013 01:59 AM, Avi Marcus wrote: >>>>>>> It sounds like I saw this on a home internet connection to a public >>>>>>> server when the connection had varying latency. >>>>>>> Once the call jittered, it never recovered. >>>>>>> My stop-gap was to add a small jitter buffer >>>>>>> <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action >>>>>>> application="jitterbuffer" data="100:200:20"/> to the user dialplan. >>>>>>> This /seemed /to make FS handle rewriting the timestamps for drift >>>>>>> rather than relying on the Linksys ATA to do that. >>>>>>> >>>>>>> Probably the wrong solution, but all I had time/understanding for. >>>>>>> -Avi >>>>>>> >>>>>>> >>>>>>> On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu> >>>>>>> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>>> wrote: >>>>>>> >>>>>>> >>>>>>> >>>>>>> On 06/24/2013 08:24 PM, Anthony Minessale wrote: >>>>>>> > fsctl debug_level 10 >>>>>>> > Also make sure ve host has high res timing. >>>>>>> >>>>>>> Turned up logging, will wait for next occurrence. >>>>>>> >>>>>>> Not sure on the latter - it's a vmware ESXi 5.1 box running FC >>>>>>> 17 x86_64 as the guest. >>>>>>> >>>>>>> /dev/rtc /dev/rtc0 exist >>>>>>> posix and soft timers are loaded in fs >>>>>>> >>>>>>> I've got a bunch of unused Dell 1950's on hand, so could use a >>>>>>> few of those machines if needed to get vmware out of the >>>>>>> picture. >>>>>>> >>>>>>> -- Nathan >>>>>>> >>>>>>> ------------------------------------------------------------ >>>>>>> Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> <mailto:nneul@mst.edu <mailto:nneul@mst.edu>> >>>>>>> Missouri S&T Information Technology (573) 612-1412 >>>>>>> <tel:%28573%29%20612-1412> >>>>>>> System Administrator - Architect >>>>>>> >>>>>>> >>>>>>> _________________________________________________________________________ >>>>>>> >>>>>>> >>>>>>> Professional FreeSWITCH Consulting Services: >>>>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> <mailto:consulting@freeswitch.org <mailto:consulting@freeswitch.org>> >>>>>>> http://www.freeswitchsolutions.com >>>>>>> >>>>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>>>> http://www.cudatel.com >>>>>>> >>>>>>> Official FreeSWITCH Sites >>>>>>> http://www.freeswitch.org >>>>>>> http://wiki.freeswitch.org >>>>>>> http://www.cluecon.com >>>>>>> >>>>>>> FreeSWITCH-users mailing list >>>>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>>>> <mailto:FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org>> >>>>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>>>> >>>>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>>>> >>>>>>> >>>>>>> http://www.freeswitch.org >>>>>>> >>>>>>> >>>>>> >>>>> >>>>> _________________________________________________________________________ >>>>> >>>>> Professional FreeSWITCH Consulting Services: >>>>> consulting@freeswitch.org <mailto:consulting@freeswitch.org> >>>>> http://www.freeswitchsolutions.com >>>>> >>>>> FreeSWITCH-powered IP PBX: The CudaTel Communication Server >>>>> http://www.cudatel.com >>>>> >>>>> Official FreeSWITCH Sites >>>>> http://www.freeswitch.org >>>>> http://wiki.freeswitch.org >>>>> http://www.cluecon.com >>>>> >>>>> FreeSWITCH-users mailing list >>>>> FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> >>>>> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users >>>>> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users >>>>> >>>>> http://www.freeswitch.org >>>>> >>>> >>
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Anthony Minessale II
FreeSWITCH http://www.freeswitch.org/ ClueCon http://www.cluecon.com/ Twitter: http://twitter.com/FreeSWITCH_wire
AIM: anthm MSN:anthony_minessale@hotmail.com <mailto:MSN%3Aanthony_minessale@hotmail.com> GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com <mailto:PAYPAL%3Aanthony.minessale@gmail.com> IRC: irc.freenode.net <http://irc.freenode.net> #freeswitch
FreeSWITCH Developer Conference sip:888@conference.freeswitch.org <mailto:sip%3A888@conference.freeswitch.org> googletalk:conf+888@conference.freeswitch.org <mailto:googletalk%3Aconf%2B888@conference.freeswitch.org> pstn:+19193869900
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- ------------------------------------------------------------ Nathan Neulinger nneul@mst.edu Missouri S&T Information Technology (573) 612-1412 System Administrator - Architect
Also of note, I'm able to reproduce this only because the ISP the calls are behind is having random(but multiple times a day) latency spikes from ~15ms normally up to ~300ms to the first gateway past the modem. William King Senior Engineer Quentus Technologies, INC 1037 NE 65th St Suite 273 Seattle, WA 98115 Main: (877) 211-9337 Office: (206) 388-4772 Cell: (253) 686-5518 william.king@quentustech.com On 06/25/2013 05:13 AM, Nathan Neulinger wrote:
I guess the big question is this:
Is it _supposed_ to recover?
From Tony's notes, it's sounding like it's very critically dependent on the timer in the switch, which very well be the current cause of my issues.
What I probably need to do is have a pair of phones automatically calling each other, and just leaving them up - just to generate a continuous independent background stream. That'll tell me if any glitches are specific to a particular channel, or if they are common across multiple calls - which I'd expect if the timer was swinging.
I don't know where my latency is being introduced unfortunately...
-- Nathan
On 06/25/2013 01:59 AM, Avi Marcus wrote:
It sounds like I saw this on a home internet connection to a public server when the connection had varying latency. Once the call jittered, it never recovered. My stop-gap was to add a small jitter buffer <http://wiki.freeswitch.org/wiki/Jitterbuffer>, e.g. <action application="jitterbuffer" data="100:200:20"/> to the user dialplan. This /seemed /to make FS handle rewriting the timestamps for drift rather than relying on the Linksys ATA to do that.
Probably the wrong solution, but all I had time/understanding for. -Avi
On Tue, Jun 25, 2013 at 4:42 AM, Nathan Neulinger <nneul@mst.edu <mailto:nneul@mst.edu>> wrote:
On 06/24/2013 08:24 PM, Anthony Minessale wrote: > fsctl debug_level 10 > Also make sure ve host has high res timing.
Turned up logging, will wait for next occurrence.
Not sure on the latter - it's a vmware ESXi 5.1 box running FC 17 x86_64 as the guest.
/dev/rtc /dev/rtc0 exist posix and soft timers are loaded in fs
I've got a bunch of unused Dell 1950's on hand, so could use a few of those machines if needed to get vmware out of the picture.
-- Nathan
------------------------------------------------------------ Nathan Neulinger nneul@mst.edu <mailto:nneul@mst.edu> Missouri S&T Information Technology (573) 612-1412 <tel:%28573%29%20612-1412> System Administrator - Architect
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript I already had to add two packages equivs libdistro-info-perl and I thought libplib1 contained the missing bit here? - building via debian wheezy: dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file. To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH. dh_shlibdeps: dpkg-shlibdeps -Tdebian/freeswitch-mod-spidermonkey.substvars debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2 make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status 2 -------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434 Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain --------------------------------------------------------------------------------
I don't think the build script is compatible with wheezy yet. Are you able to reproduce the same problem on master HEAD for squeeze? Can you file a JIRA ticket for this, and test the above, and I'll take a look later. Thanks Cal On Wed, Jun 26, 2013 at 2:00 AM, Karl Schmidt <karl@xtronics.com> wrote:
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript
I already had to add two packages equivs libdistro-info-perl
and I thought libplib1 contained the missing bit here?
- building via debian wheezy:
dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file. To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH. dh_shlibdeps: dpkg-shlibdeps -Tdebian/freeswitch-mod-spidermonkey.substvars debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2 make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status 2
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 06/26/2013 09:36 AM, Cal Leeming [Simplicity Media Ltd] wrote:
I don't think the build script is compatible with wheezy yet.
That is what I'm bumping into.. Looks like 'Steve Ayre' may have been the one to create this script?
Are you able to reproduce the same problem on master HEAD for squeeze?
I'm just starting to explore freeswitch - no longer run any squeeze machines as wheezy is now stable. The script pulls in via this command: git clone -b $BRANCH git://git.freeswitch.org/freeswitch.git
Can you file a JIRA ticket for this, and test the above, and I'll take a look later.
I could - have no idea how - I'm brand new to freeswitch ( I used asterisk for a glorified answering machine-2-email system for many years now). The key issue is : error: couldn't find library libjs.so.1 It is in libplib1 which is installed The other issue, which might be related is a huge number of warnings similar to: dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-lua/usr/lib/freeswitch/mod/mod_lua.so was not linked against libz.so.1 (it uses none of the library's symbols) I'm thinking it might be related to this warning : To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH.
Thanks
Cal
On Wed, Jun 26, 2013 at 2:00 AM, Karl Schmidt <karl@xtronics.com <mailto:karl@xtronics.com>> wrote:
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript
I already had to add two packages equivs libdistro-info-perl
and I thought libplib1 contained the missing bit here?
- building via debian wheezy:
dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file. To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH. dh_shlibdeps: dpkg-shlibdeps -Tdebian/freeswitch-mod-spidermonkey.substvars debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2 make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status 2
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com <mailto:Karl@xtronics.com> Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 <tel:%28785%29%20841-3089> Lawrence, KS 66049 FAX (785) 841-0434 <tel:%28785%29%20841-0434>
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:FreeSWITCH-users@lists.freeswitch.org> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- -------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434 Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain --------------------------------------------------------------------------------
I'll test it on a Wheezy machine this week. In the meantime try Ken's suggestion. -Steve On 26 June 2013 17:42, Karl Schmidt <karl@xtronics.com> wrote:
On 06/26/2013 09:36 AM, Cal Leeming [Simplicity Media Ltd] wrote:
I don't think the build script is compatible with wheezy yet.
That is what I'm bumping into.. Looks like 'Steve Ayre' may have been the one to create this script?
Are you able to reproduce the same problem on master HEAD for squeeze?
I'm just starting to explore freeswitch - no longer run any squeeze machines as wheezy is now stable. The script pulls in via this command:
git clone -b $BRANCH git://git.freeswitch.org/freeswitch.git
Can you file a JIRA ticket for this, and test the above, and I'll take a
look later.
I could - have no idea how - I'm brand new to freeswitch ( I used asterisk for a glorified answering machine-2-email system for many years now).
The key issue is : error: couldn't find library libjs.so.1
It is in libplib1 which is installed
The other issue, which might be related is a huge number of warnings similar to:
dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-lua/usr/lib/freeswitch/mod/mod_lua.so was not linked against libz.so.1 (it uses none of the library's symbols)
I'm thinking it might be related to this warning :
To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH.
Thanks
Cal
On Wed, Jun 26, 2013 at 2:00 AM, Karl Schmidt <karl@xtronics.com<mailto:
karl@xtronics.com>> wrote:
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript
I already had to add two packages equivs libdistro-info-perl
and I thought libplib1 contained the missing bit here?
- building via debian wheezy:
dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format:
'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format:
'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against
libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do
not have any shlibs or symbols
file. To help dpkg-shlibdeps find private libraries, you might need to set
LD_LIBRARY_PATH.
dh_shlibdeps: dpkg-shlibdeps
-Tdebian/freeswitch-mod-spidermonkey.substvars
debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2
make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status
2
--------------------------------------------------------------------------------
Karl Schmidt EMail
Karl@xtronics.com <mailto:Karl@xtronics.com>
Transtronics, Inc. WEB
http://secure.transtronics.com
3209 West 9th Street Ph (785) 841-3089<tel:%28785%29%20841-3089> Lawrence, KS 66049 FAX (785) 841-0434<tel:%28785%29%20841-0434>
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________
Professional FreeSWITCH Consulting Services: consulting@freeswitch.org <mailto:consulting@freeswitch.org> http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org <mailto:
FreeSWITCH-users@lists.freeswitch.org>
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:
http://lists.freeswitch.org/mailman/options/freeswitch-users
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
--
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Building debian packages from freeswitch is as simple as using atleast wheezy then executing the following script ./debian/util.sh build-all -bn -z9 -v1 I suggestion something like this to checkout out the source from git mkdir -p /usr/src/freeswitch cd /usr/src/freeswitch git clone git://git.freeswitch.org/freeswitch.git src cd src ./debian/util.sh build-all -bn -z9 -v1 This will build packages for squeeze thru sid and leave them in your /usr/src/freeswitch directory along with log and .change files The script uses cows for building each version (both x86 and x86_64 arches) On 6/25/13 8:00 PM, "Karl Schmidt" <karl@xtronics.com> wrote:
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript
I already had to add two packages equivs libdistro-info-perl
and I thought libplib1 contained the missing bit here?
- building via debian wheezy:
dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file. To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH. dh_shlibdeps: dpkg-shlibdeps -Tdebian/freeswitch-mod-spidermonkey.substvars debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2 make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status 2
------------------------------------------------------------------------------ -- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
------------------------------------------------------------------------------ --
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Ken http://www.FreeSWITCH.org http://www.ClueCon.com http://www.OSTAG.org irc.freenode.net #freeswitch
On 06/26/2013 10:07 AM, Ken Rice wrote:
Building debian packages from freeswitch is as simple as using atleast wheezy then executing the following script
./debian/util.sh build-all -bn -z9 -v1
This would replace dpkg-buildpackage -b -uc ?? in the script at http://wiki.freeswitch.org/wiki/Debian_packages_buildscript ? I have other packages I build and they all use dpkg-buildpackage -b -uc -us
I suggestion something like this to checkout out the source from git
mkdir -p /usr/src/freeswitch cd /usr/src/freeswitch git clone git://git.freeswitch.org/freeswitch.git src cd src ./debian/util.sh build-all -bn -z9 -v1
How is that different than git clone -b v1.2.stable git://git.freeswitch.org/freeswitch.git from the script?
This will build packages for squeeze thru sid and leave them in your /usr/src/freeswitch directory along with log and .change files
The script uses cows for building each version (both x86 and x86_64 arches)
I'm on wheezy amd64 - the current stable for Debian. -------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434 Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain --------------------------------------------------------------------------------
I you can look at that script to see what all it does... We use this for automating the entire build and packaging process for Debian On 6/26/13 12:26 PM, "Karl Schmidt" <karl@xtronics.com> wrote:
On 06/26/2013 10:07 AM, Ken Rice wrote:
Building debian packages from freeswitch is as simple as using atleast wheezy then executing the following script
./debian/util.sh build-all -bn -z9 -v1
This would replace dpkg-buildpackage -b -uc ??
in the script at http://wiki.freeswitch.org/wiki/Debian_packages_buildscript ?
I have other packages I build and they all use dpkg-buildpackage -b -uc -us
I suggestion something like this to checkout out the source from git
mkdir -p /usr/src/freeswitch cd /usr/src/freeswitch git clone git://git.freeswitch.org/freeswitch.git src cd src ./debian/util.sh build-all -bn -z9 -v1
How is that different than
git clone -b v1.2.stable git://git.freeswitch.org/freeswitch.git
from the script?
This will build packages for squeeze thru sid and leave them in your /usr/src/freeswitch directory along with log and .change files
The script uses cows for building each version (both x86 and x86_64 arches)
I'm on wheezy amd64 - the current stable for Debian.
------------------------------------------------------------------------------ -- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
------------------------------------------------------------------------------ --
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Ken http://www.FreeSWITCH.org http://www.ClueCon.com http://www.OSTAG.org irc.freenode.net #freeswitch
Hi Karl, First of all, welcome to FreeSWITCH :) To raise a JIRA ticket, go to [1] and register your account, then create a new "issue" under the FreeSWITCH project. There is a whole bunch of documentation about this in [2] but it's all pretty simple. This adds a couple more mins overhead, but it's impossible to track these problems in the ML so having it in JIRA will ensure it gets dealt with eventually. In reference to your original question, the build script made by Steven at [3] does work fine under Squeeze, but I have not yet tested it for Wheezy. You should just be able to use "dpkg-buildpackage -b -uc -us", I have not used the "./debian/util.sh" tool yet so I cannot comment on how reliable it is (although both Ken and Steven are very knowledgeable, and their advice is usually accurate). As for the original problem itself relating to libjs.so.1, I've just done a build test on a wheezy amd64 chroot (with dev/sys/proc properly mounted etc)... I hate waiting for compiles... I was able to compile the packages without problem using [4], and you can see the full compile results at [5]. Please have a read through [4] and make sure you have not missed any of the steps, also try creating a clean build environment from scratch as sometimes this can fix many problems. Also be aware that FS is not currently compatible with pbuilder and the alike, so attempting to use it in conjunction with any of those tools might not work. Also note that this build was done on a wheezy chroot.. if you are attempting to build wheezy packages from a non wheezy chroot, then it might not work as expected. Generally speaking this is why you'd normally use pbuilder by default, but just creating a chroot as shown in my example will suffice in the event of pbuilder not being compatible :) For now I'm going to mark this as "works for me", but if you get any more problems or questions, feel free to update the thread (and/or a JIRA ticket!). Hope this helps Cal [1] http://jira.freeswitch.org/secure/Dashboard.jspa [2] http://wiki.freeswitch.org/wiki/Reporting_Bugs#Reporting_A_Bug_With_JIRA [3] http://wiki.freeswitch.org/wiki/Debian_packages_buildscript [4] http://pastebin.com/gCgEmH90 [5] https://www.dropbox.com/s/zepvn4mj4ly8l5q/fs-compile-26-06-2013.txt On Wed, Jun 26, 2013 at 6:26 PM, Karl Schmidt <karl@xtronics.com> wrote:
On 06/26/2013 10:07 AM, Ken Rice wrote:
Building debian packages from freeswitch is as simple as using atleast wheezy then executing the following script
./debian/util.sh build-all -bn -z9 -v1
This would replace dpkg-buildpackage -b -uc ??
in the script at http://wiki.freeswitch.org/wiki/Debian_packages_buildscript ?
I have other packages I build and they all use dpkg-buildpackage -b -uc -us
I suggestion something like this to checkout out the source from git
mkdir -p /usr/src/freeswitch cd /usr/src/freeswitch git clone git://git.freeswitch.org/freeswitch.git src cd src ./debian/util.sh build-all -bn -z9 -v1
How is that different than
git clone -b v1.2.stable git://git.freeswitch.org/freeswitch.git
from the script?
This will build packages for squeeze thru sid and leave them in your /usr/src/freeswitch directory along with log and .change files
The script uses cows for building each version (both x86 and x86_64 arches)
I'm on wheezy amd64 - the current stable for Debian.
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
./debian/util.sh build-all -bn -z9 -v1
This would replace dpkg-buildpackage -b -uc ??
Actually it more likely calls it for you (or git-buildpackage which'd call it in turn). Those are the debian tools for creating packages, that script'll call them for you as appropriate.
mkdir -p /usr/src/freeswitch
cd /usr/src/freeswitch git clone git://git.freeswitch.org/freeswitch.git src cd src ./debian/util.sh build-all -bn -z9 -v1
How is that different than git clone -b v1.2.stable git://git.freeswitch.org/freeswitch.git
It isn't - first four lines do the same, just to a different location. The main advantage of my script incidentally is it uses mk-build-deps (from the devscripts package) to create and install a package that depends on all the build dependencies for building the freeswitch packages. That means you don't need to then install them yourself, and afterwards can remove that package then 'apt-get autoremove' to clean up your system, if you wish to do so.
What other steps did you take other than that buildscript? mod_spidermonkey isn't built by the debian packages by default. For the record the buildscript appears to work just fine on Wheezy, although I haven't tried adding mod_spidermonkey to the selected build modules yet. -Steve On 26 June 2013 02:00, Karl Schmidt <karl@xtronics.com> wrote:
I'm getting errors using the build script found here: http://wiki.freeswitch.org/wiki/Debian_packages_buildscript
I already had to add two packages equivs libdistro-info-perl
and I thought libplib1 contained the missing bit here?
- building via debian wheezy:
dpkg-shlibdeps: error: couldn't find library libjs.so.1 needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: couldn't find library libnspr4.so needed by debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so (ELF format: 'elf64-x86-64'; RPATH: '') dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libtinfo.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libjpeg.so.8 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libodbc.so.1 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libpq.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libm.so.6 (it uses none of the library's symbols) dpkg-shlibdeps: warning: package could avoid a useless dependency if debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so was not linked against libncurses.so.5 (it uses none of the library's symbols) dpkg-shlibdeps: error: cannot continue due to the error above Note: libraries are not searched in other binary packages that do not have any shlibs or symbols file. To help dpkg-shlibdeps find private libraries, you might need to set LD_LIBRARY_PATH. dh_shlibdeps: dpkg-shlibdeps -Tdebian/freeswitch-mod-spidermonkey.substvars debian/freeswitch-mod-spidermonkey/usr/lib/freeswitch/mod/mod_spidermonkey.so returned exit code 2 make: *** [binary] Error 2 dpkg-buildpackage: error: debian/rules binary gave error exit status 2
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
Truth is mighty and will prevail. There is nothing wrong with this, except that it ain't so. --Mark Twain
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
On 06/27/2013 04:03 AM, Steven Ayre wrote:
What other steps did you take other than that buildscript?
mod_spidermonkey isn't built by the debian packages by default.
For the record the buildscript appears to work just fine on Wheezy, although I haven't tried adding mod_spidermonkey to the selected build modules yet.
The problem is I was trying to use a custom modules.conf - that was produced with the non debian bootstrap.sh - which I had already run. Once I found that there were prebuilt debs at: deb http://files.freeswitch.org/repo/deb/debian/ wheezy main I changed directions. There are a few minor issues in the deb packages: - base_dir was wrong (missing? ) - easy fix - The tetris was in the wrong place. - I had to install several other packages besides what the meta packages pulled in - I can't figure out which package has FreeTDM ( I think I need that for a Digium, Inc. Wildcard AEX410 4-port analog card (PCI-Express) I want to support ). I've been putting my notes on doing this the Debian way together here: http://wiki.xtronics.com/index.php/Freeswitch There are probably too many packages (280 ) and the meta packages aren't right, but I very happy that someone is trying to get this in shape to put in Debian ( it is work - but worth doing for security reasons if nothing else. Also, once in the Debian archive, it will feed in to ALL the other debian based distributions - greatly expanding the number and quality of contributors) -------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434 So that the record of history is absolutely crystal clear. That there is no alternative way, so far discovered, of improving the lot of the ordinary people that can hold a candle to the productive activities that are unleashed by a free enterprise system. Milton Friedman --------------------------------------------------------------------------------
In ref to the FHS comment on your wiki (getting FS cleaned up for official debian package inclusion) there was a recent discussion on the ML [2] about this and there's also a ticket [1]. Also, please feel free to contribute patches to any bugs relating to wheezy, just make sure you raise a JIRA and do as much testing as possible to reduce the stress on Steven (as he will probably be the one signing this off). Thanks Cal [1] http://jira.freeswitch.org/browse/FS-340 [2] http://lists.freeswitch.org/pipermail/freeswitch-users/2013-March/093616.htm... On Fri, Jun 28, 2013 at 9:35 PM, Karl Schmidt <karl@xtronics.com> wrote:
On 06/27/2013 04:03 AM, Steven Ayre wrote:
What other steps did you take other than that buildscript?
mod_spidermonkey isn't built by the debian packages by default.
For the record the buildscript appears to work just fine on Wheezy, although I haven't tried adding mod_spidermonkey to the selected build modules yet.
The problem is I was trying to use a custom modules.conf - that was produced with the non debian bootstrap.sh - which I had already run.
Once I found that there were prebuilt debs at:
deb http://files.freeswitch.org/repo/deb/debian/ wheezy main
I changed directions. There are a few minor issues in the deb packages:
- base_dir was wrong (missing? ) - easy fix
- The tetris was in the wrong place.
- I had to install several other packages besides what the meta packages pulled in
- I can't figure out which package has FreeTDM ( I think I need that for a Digium, Inc. Wildcard AEX410 4-port analog card (PCI-Express) I want to support ).
I've been putting my notes on doing this the Debian way together here: http://wiki.xtronics.com/index.php/Freeswitch
There are probably too many packages (280 ) and the meta packages aren't right, but I very happy that someone is trying to get this in shape to put in Debian ( it is work - but worth doing for security reasons if nothing else. Also, once in the Debian archive, it will feed in to ALL the other debian based distributions - greatly expanding the number and quality of contributors)
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
So that the record of history is absolutely crystal clear. That there is no alternative way, so far discovered, of improving the lot of the ordinary people that can hold a candle to the productive activities that are unleashed by a free enterprise system. Milton Friedman
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
Just for the record I wrote the script on the Wiki but I don't look after the packaging itself, or the repo. Travis Cross is responsible for the packaging (still?), not sure who's running the repo -Steve On 28 June 2013 21:54, Cal Leeming [Simplicity Media Ltd] < cal.leeming@simplicitymedialtd.co.uk> wrote:
In ref to the FHS comment on your wiki (getting FS cleaned up for official debian package inclusion) there was a recent discussion on the ML [2] about this and there's also a ticket [1].
Also, please feel free to contribute patches to any bugs relating to wheezy, just make sure you raise a JIRA and do as much testing as possible to reduce the stress on Steven (as he will probably be the one signing this off).
Thanks
Cal
[1] http://jira.freeswitch.org/browse/FS-340 [2] http://lists.freeswitch.org/pipermail/freeswitch-users/2013-March/093616.htm...
On Fri, Jun 28, 2013 at 9:35 PM, Karl Schmidt <karl@xtronics.com> wrote:
On 06/27/2013 04:03 AM, Steven Ayre wrote:
What other steps did you take other than that buildscript?
mod_spidermonkey isn't built by the debian packages by default.
For the record the buildscript appears to work just fine on Wheezy, although I haven't tried adding mod_spidermonkey to the selected build modules yet.
The problem is I was trying to use a custom modules.conf - that was produced with the non debian bootstrap.sh - which I had already run.
Once I found that there were prebuilt debs at:
deb http://files.freeswitch.org/repo/deb/debian/ wheezy main
I changed directions. There are a few minor issues in the deb packages:
- base_dir was wrong (missing? ) - easy fix
- The tetris was in the wrong place.
- I had to install several other packages besides what the meta packages pulled in
- I can't figure out which package has FreeTDM ( I think I need that for a Digium, Inc. Wildcard AEX410 4-port analog card (PCI-Express) I want to support ).
I've been putting my notes on doing this the Debian way together here: http://wiki.xtronics.com/index.php/Freeswitch
There are probably too many packages (280 ) and the meta packages aren't right, but I very happy that someone is trying to get this in shape to put in Debian ( it is work - but worth doing for security reasons if nothing else. Also, once in the Debian archive, it will feed in to ALL the other debian based distributions - greatly expanding the number and quality of contributors)
-------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434
So that the record of history is absolutely crystal clear. That there is no alternative way, so far discovered, of improving the lot of the ordinary people that can hold a candle to the productive activities that are unleashed by a free enterprise system. Milton Friedman
--------------------------------------------------------------------------------
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
For some reason I cant find the original message, But if there are problems with the packages reporting them on the mailing list is not the correct action... Open a Jira so the issue can be a) routed to the proper developer, and b) any work on the issue can be properly documented and tracked. This is just like any one bug or issue On 6/29/13 5:31 PM, "Steven Ayre" <steveayre@gmail.com> wrote:
Just for the record I wrote the script on the Wiki but I don't look after the packaging itself, or the repo.
Travis Cross is responsible for the packaging (still?), not sure who's running the repo
-Steve
On 28 June 2013 21:54, Cal Leeming [Simplicity Media Ltd] <cal.leeming@simplicitymedialtd.co.uk> wrote:
In ref to the FHS comment on your wiki (getting FS cleaned up for official debian package inclusion) there was a recent discussion on the ML [2] about this and there's also a ticket [1].
Also, please feel free to contribute patches to any bugs relating to wheezy, just make sure you raise a JIRA and do as much testing as possible to reduce the stress on Steven (as he will probably be the one signing this off).
Thanks
Cal
[1] http://jira.freeswitch.org/browse/FS-340 [2] http://lists.freeswitch.org/pipermail/freeswitch-users/2013-March/093616. html
On Fri, Jun 28, 2013 at 9:35 PM, Karl Schmidt <karl@xtronics.com> wrote:
On 06/27/2013 04:03 AM, Steven Ayre wrote:
What other steps did you take other than that buildscript?
mod_spidermonkey isn't built by the debian packages by default.
For the record the buildscript appears to work just fine on Wheezy, although I haven't tried adding mod_spidermonkey to the selected build modules yet.
The problem is I was trying to use a custom modules.conf - that was produced with the non debian bootstrap.sh - which I had already run.
Once I found that there were prebuilt debs at:
deb http://files.freeswitch.org/repo/deb/debian/ wheezy main
I changed directions. There are a few minor issues in the deb packages:
- base_dir was wrong (missing? ) - easy fix
- The tetris was in the wrong place.
- I had to install several other packages besides what the meta packages pulled in
- I can't figure out which package has FreeTDM ( I think I need that for a Digium, Inc. Wildcard AEX410 4-port analog card (PCI-Express) I want to support ).
I've been putting my notes on doing this the Debian way together here: http://wiki.xtronics.com/index.php/Freeswitch
There are probably too many packages (280 ) and the meta packages aren't right, but I very happy that someone is trying to get this in shape to put in Debian ( it is work - but worth doing for security reasons if nothing else. Also, once in the Debian archive, it will feed in to ALL the other debian based distributions - greatly expanding the number and quality of contributors)
---------------------------------------------------------------------------- ---- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 <tel:%28785%29%20841-3089> Lawrence, KS 66049 FAX (785) 841-0434 <tel:%28785%29%20841-0434>
So that the record of history is absolutely crystal clear. That there is no alternative way, so far discovered, of improving the lot of the ordinary people that can hold a candle to the productive activities that are unleashed by a free enterprise system. Milton Friedman ---------------------------------------------------------------------------- ----
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
FreeSWITCH-powered IP PBX: The CudaTel Communication Server http://www.cudatel.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Ken http://www.FreeSWITCH.org http://www.ClueCon.com http://www.OSTAG.org irc.freenode.net #freeswitch
Made a bit of progress: Found this from the debian build script. (with out the word 'error' to grep for )
libdistro-info-perl is not installed, Debian release names are not known.
# apt-get install libdistro-info-perl -------------------------------------------------------------------------------- Karl Schmidt EMail Karl@xtronics.com Transtronics, Inc. WEB http://secure.transtronics.com 3209 West 9th Street Ph (785) 841-3089 Lawrence, KS 66049 FAX (785) 841-0434 The main plank in the National Socialist program is to abolish the liberalistic concept of the individual... Adolf Hitler --------------------------------------------------------------------------------
participants (8)
-
Anthony Minessale
-
Avi Marcus
-
Cal Leeming [Simplicity Media Ltd]
-
Karl Schmidt
-
Ken Rice
-
Nathan Neulinger
-
Steven Ayre
-
William King