Words like delay can lead to a lot of confusion because there are so many ways the word is used.

The delay problem William is talking about is a permanent delay that was a brief bug we had where the audio streams were always out of sync.

The problem described sounds more like "setup delay" which is: The audio is in sync but its not bi-directional for a long period of time.  This sounds to me like one of the many Sonus bugs we have fought where passing rtp streams to a Sonus would cause it to restart its jitter buffer and eat up audio.

What you should do follow these steps:


1) Install GIT HEAD (not stable branch) because the stable branch cannot be modified and the code is too old to diagnose problems on.

2) Reproduce the problem and get traces / log caps.  (if you cannot reproduce it on demand its likely an environmental issue since most delay bugs that are our fault are consistent) 


3) Report them to JIRA not to this mailing list.  Problems are impossible to track over email... That's why we have an issue tracker.


Re-reading this :  I see you mentioned ATT so its almost for sure the Sonus bug.

Try this:

edit your sofia profile and set the param rtp-rewrite-timestamps to true

My suspicion: The ATT calls you, then it bridges over to FS that maybe sends some data like playing a "please hold" sound or enters a queue something.  Then bridges to a phone.  By default we preserve timestamps on RTP so when we send the stamps from the phone it confuses it and makes it go insane.   This param will rewrite all timestamps so it always sees them coming from a generated base rather than passing them.


BTW: "thousands of calls per second" ... no ... That's why we don't touch the subject of load testing....
















On Mon, Jan 14, 2013 at 4:02 PM, Brent Paddon <brent.paddon@gmail.com> wrote:
Figure out how to use Wireshark and a SPAN (mirror) port on your switch(es) and things will become a lot clearer for you.  You'll be able to see what is actually happening on the network instead of guessing.

Brent


On Tue, Jan 15, 2013 at 2:32 AM, Blake Priddy <bpriddy@bryantschools.org> wrote:
Well our server has 6 cores. William, we are running stable on debian. Any other brain busters? I need as many possibilites of issues as possible. Roger, we have gig across the network. But I will give it a shot just to eliminate that possibility.


On Mon, Jan 14, 2013 at 10:10 AM, Roger Castaldo <roger.castaldo@gmail.com> wrote:
Another option, to at least eliminate issues, assuming it happens on all calls is to connect a phone either directly to the server, ie spare nic port or as close as possible, ie same switch and perform an external call to that phone to see if the delay occurs.  This would at least allow you to eliminate a network latency between the server and the secretaries phone which would cause delays in audio as well since freeswitch cannot send audio if the audio hasn't arrived to it yet.  Just a thought on trying to eliminate the possible.


On Mon, Jan 14, 2013 at 10:47 AM, William King <william.king@quentustech.com> wrote:
Do you happen to be running the stable branch? If so then I believe the
issue you are hitting was already fixed in master. If you have a chance
to test, see if the length of the audio delay is about the same amount
of time as the secretaries phone was ringing. If that is the case, then
it should already be fixed in master.

William King
Senior Engineer
Quentus Technologies, INC
1037 NE 65th St Suite 273
Seattle, WA 98115
Main:   (877) 211-9337
Office: (206) 388-4772
Cell:   (253) 686-5518
william.king@quentustech.com

On 01/14/2013 06:45 AM, Blake Priddy wrote:
> Ok everyone, hope your new years went wonderful! So here is the
> situation again. THE DELAY IS BACK! I have wiped FS and installed the
> latest git head and the delay is still present. I want to eliminate all
> FS options that could fix it before I call AT&T. Any help is
> appreciated! Person from outside the school calls, secretary answers,
> secretary hears they person saying hello, secretary says hello over and
> over again for 10 seconds. Then the B-Leg audio finally is heard by the
> A-LEG. Note* The B-Leg (secretary) can hear the A-leg talking the whole
> time. Just the A-Leg cannot hear the (secretary) B-Leg until about 7-13
> seconds has passed. I see nothing in the FS log after the audio from the
> B-Leg finally traverses to the A-Leg. Please help our school fellow FS
> users!
>
> LONG LIVE FS!!! :)
>
> --
>
> *Blakelund Priddy*
> Network Systems Engineer
> Bryant Public School District
> Bryant, Arkansas 72022
> http://www.bryantschools.org <http://www.bryantschools.org/>
> p 501-653-5038
> f 501-847-5656
>
>
> _________________________________________________________________________
> Professional FreeSWITCH Consulting Services:
> consulting@freeswitch.org
> http://www.freeswitchsolutions.com
>
> FreeSWITCH-powered IP PBX: The CudaTel Communication Server
> http://www.cudatel.com
>
> Official FreeSWITCH Sites
> http://www.freeswitch.org
> http://wiki.freeswitch.org
> http://www.cluecon.com
>
> FreeSWITCH-users mailing list
> FreeSWITCH-users@lists.freeswitch.org
> http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
> UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
> http://www.freeswitch.org

_________________________________________________________________________
Professional FreeSWITCH Consulting Services:
consulting@freeswitch.org
http://www.freeswitchsolutions.com

FreeSWITCH-powered IP PBX: The CudaTel Communication Server
http://www.cudatel.com

Official FreeSWITCH Sites
http://www.freeswitch.org
http://wiki.freeswitch.org
http://www.cluecon.com

FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
http://www.freeswitch.org


_________________________________________________________________________
Professional FreeSWITCH Consulting Services:
consulting@freeswitch.org
http://www.freeswitchsolutions.com

FreeSWITCH-powered IP PBX: The CudaTel Communication Server
http://www.cudatel.com

Official FreeSWITCH Sites
http://www.freeswitch.org
http://wiki.freeswitch.org
http://www.cluecon.com

FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
http://www.freeswitch.org




--

Blakelund Priddy

Network Systems Engineer
Bryant Public School District
Bryant, Arkansas 72022
http://www.bryantschools.org
p 501-653-5038
f 501-847-5656

_________________________________________________________________________
Professional FreeSWITCH Consulting Services:
consulting@freeswitch.org
http://www.freeswitchsolutions.com

FreeSWITCH-powered IP PBX: The CudaTel Communication Server
http://www.cudatel.com

Official FreeSWITCH Sites
http://www.freeswitch.org
http://wiki.freeswitch.org
http://www.cluecon.com

FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
http://www.freeswitch.org



_________________________________________________________________________
Professional FreeSWITCH Consulting Services:
consulting@freeswitch.org
http://www.freeswitchsolutions.com

FreeSWITCH-powered IP PBX: The CudaTel Communication Server
http://www.cudatel.com

Official FreeSWITCH Sites
http://www.freeswitch.org
http://wiki.freeswitch.org
http://www.cluecon.com

FreeSWITCH-users mailing list
FreeSWITCH-users@lists.freeswitch.org
http://lists.freeswitch.org/mailman/listinfo/freeswitch-users
UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users
http://www.freeswitch.org




--
Anthony Minessale II

FreeSWITCH http://www.freeswitch.org/
ClueCon http://www.cluecon.com/
Twitter: http://twitter.com/FreeSWITCH_wire

AIM: anthm
MSN:anthony_minessale@hotmail.com
GTALK/JABBER/PAYPAL:anthony.minessale@gmail.com
IRC: irc.freenode.net #freeswitch

FreeSWITCH Developer Conference
sip:888@conference.freeswitch.org
googletalk:conf+888@conference.freeswitch.org
pstn:+19193869900