<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:70.85pt 70.85pt 70.85pt 70.85pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:129444114;
mso-list-type:hybrid;
mso-list-template-ids:321265810 1159745600 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-start-at:2019;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-font-family:Calibri;}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal">Hello,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We’ve recently upgraded some of our servers to 1.8.5 and are now occasionally experiencing the error “too many stacked extensions” for some calls.
<o:p></o:p></p>
<p class="MsoNormal">According to Jira this has been patched since 1.8.1, but perhaps this is due to some other scenario being triggered.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">We’re using ESL (bgapi command) to spawn a python script which in turn does an originate.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">See below a snippet of the cli output.<o:p></o:p></p>
<p class="MsoNormal">As far as I can tell, this doesn’t have any real consequences resource consumption wise (CPU and memory), only the disk will get hammered in the case when logging to syslog.<o:p></o:p></p>
<p class="MsoNormal">Also, I haven’t been able to reproduce this myself, but I’m still in the process of doing more testing.
<o:p></o:p></p>
<p class="MsoNormal">It seems to be happening before the call is connected to the destination.<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Any ideas how to properly debug this and find out what’s triggering this?<o:p></o:p></p>
<p class="MsoNormal">I’ve tried the following:<o:p></o:p></p>
<ul style="margin-top:0cm" type="disc">
<li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1">Monitoring all ESL events<o:p></o:p></li><li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1">fsctl debug_level 10<o:p></o:p></li><li class="MsoListParagraph" style="margin-left:0cm;mso-list:l0 level1 lfo1">sofia loglevel all 9<o:p></o:p></li></ul>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">They all output a lot of debugging information, which does get overwhelming.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">In a nutshell, this is the flow:<o:p></o:p></p>
<p class="MsoNormal">ESL: <o:p></o:p></p>
<p class="MsoNormal">bgapi pyrun app originateCommand<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Python:<o:p></o:p></p>
<p class="MsoNormal">session = freeswitch.Session(originateCommand)<o:p></o:p></p>
<p class="MsoNormal">session.execute("wait_for_answer")<o:p></o:p></p>
<p class="MsoNormal">session.streamFile(file)<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ALERT] switch_core_session.c:1047 Send signal sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 [BREAK]<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ALERT] switch_core_state_machine.c:705 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread wake state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.133457 [ALERT] switch_core_state_machine.c:701 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread sleep state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.153454 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.173495 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.193453 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.213458 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.233455 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ALERT] switch_core_session.c:1047 Send signal sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 [BREAK]<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ALERT] switch_core_state_machine.c:705 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread wake state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.253489 [ALERT] switch_core_state_machine.c:701 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread sleep state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.273448 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.293454 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.313459 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.333443 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.353456 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ALERT] switch_core_session.c:1047 Send signal sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 [BREAK]<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ALERT] switch_core_state_machine.c:705 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread wake state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.373450 [ALERT] switch_core_state_machine.c:701 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread sleep state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.393440 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.413450 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.433452 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.453461 [ERR] switch_ivr.c:904 Error sofia/local_eth0/00393421615027@10.14.26.10:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ALERT] switch_core_session.c:1047 Send signal sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 [BREAK]<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ALERT] switch_core_state_machine.c:705 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread wake state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.473474 [ALERT] switch_core_state_machine.c:701 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 session thread sleep state: CS_SOFT_EXECUTE!<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.493452 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.513447 [ALERT] switch_rtp.c:7695 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio timeout<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.513447 [ALERT] switch_rtp.c:1584 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio stat 99.00 301/302 flaws: 1 mos: 4.49 v: 0.11 0.11/1.78<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.513447 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.533439 [ALERT] switch_rtp.c:7695 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio timeout<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.533439 [ALERT] switch_rtp.c:1565 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio 2 consecutive flaws, adding 2 flaw penalty<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.533439 [ALERT] switch_rtp.c:1584 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio stat 98.00 298/302 flaws: 4 mos: 4.48 v: 0.11 0.11/1.78<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.533439 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.553450 [ALERT] switch_rtp.c:7695 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio timeout<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.553450 [ALERT] switch_rtp.c:1565 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio 3 consecutive flaws, adding 2 flaw penalty<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.553450 [ALERT] switch_rtp.c:1584 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio stat 97.00 295/302 flaws: 7 mos: 4.47 v: 0.11 0.11/1.78<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.553450 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.573441 [ALERT] switch_rtp.c:7695 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio timeout<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.573441 [ALERT] switch_rtp.c:1565 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio 4 consecutive flaws, adding 2 flaw penalty<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.573441 [ALERT] switch_rtp.c:1584 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio stat 96.00 292/302 flaws: 10 mos: 4.46 v: 0.11 0.11/1.78<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.573441 [ERR] switch_ivr.c:904 Error sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 too many stacked extensions<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.593450 [ALERT] switch_rtp.c:7695 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio timeout<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.593450 [ALERT] switch_rtp.c:1565 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio 5 consecutive flaws, adding 2 flaw penalty<o:p></o:p></p>
<p class="MsoNormal">2019-03-11 12:58:08.593450 [ALERT] switch_rtp.c:1584 sofia/local_eth0/XXXXXXXXXX@X.X.X.X:5060 audio stat 95.00 289/302 flaws: 13 mos: 4.44 v: 0.11 0.11/1.78<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Regards,<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Grant<o:p></o:p></p>
</div>
</body>
</html>