<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Are you using the call centre module? If so, we've ran into issues with the FS SQLite thread (single child process) becoming CPU bound, you can fix it by using an RDBMS such as PGSQL which is multi-threaded.</div>
<div>
<div id="appendonsend"></div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" color="#000000" style="font-size:11pt"><b>From:</b> FreeSWITCH-users <freeswitch-users-bounces@lists.freeswitch.org> on behalf of ziv@ip-com.co.il <ziv@ip-com.co.il><br>
<b>Sent:</b> 12 October 2020 10:34<br>
<b>To:</b> 'FreeSWITCH Users Help' <freeswitch-users@lists.freeswitch.org><br>
<b>Subject:</b> Re: [Freeswitch-users] Freeswitch CPU consumption on AWS EC2</font>
<div> </div>
</div>
<div lang="en-IL" style="word-wrap:break-word">
<div class="x_WordSection1">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="">Assuming it’s 1258 one-session calls, and remembering that c5.4xlarge has 4 times more CPU than c5.xlarge, and taking into account that my test was on 30 seconds call vs. 200 seconds call in your test, it seems that our findings
are similar.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US" style="">This makes the FreeSWITCH deployment costly. There must be a way to reduce CPU consumption.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="en-IL" style=""> </span></p>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<b><span lang="EN-US">From:</span></b><span lang="EN-US"> FreeSWITCH-users <freeswitch-users-bounces@lists.freeswitch.org>
<b>On Behalf Of </b>Sergey Safarov<br>
<b>Sent:</b> Monday, October 12, 2020 10:30 AM<br>
<b>To:</b> FreeSWITCH Users Help <freeswitch-users@lists.freeswitch.org><br>
<b>Subject:</b> Re: [Freeswitch-users] Freeswitch CPU consumption on AWS EC2</span></p>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
my test results using sipp script + FreeSWITCH docker container + PCMU on c5.4xlarge instance only audio stream. Each call duration is 200 seconds.</p>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
Tested Kazoo all-in-one install. So, here some overhead exit for Elang components.<br>
<br>
According to load test on c5.4xlarge Amazon instance after 282 seconds is reached 1258 simultaneous calls at 6 calls per second rate. During the test all calls and registrations are successful. During the test CPU load is reached 79% value, memory usage 7Gb,
and 150 mb/s total network usage over all docker containers on "all-in-one" Kazoo configuration.</p>
</div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
</div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
Sergey</p>
</div>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
</p>
<div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
On Sun, Oct 11, 2020 at 1:51 PM <<a href="mailto:ziv@ip-com.co.il">ziv@ip-com.co.il</a>> wrote:</p>
</div>
<blockquote style="border:none; border-left:solid #CCCCCC 1.0pt; padding:0cm 0cm 0cm 6.0pt; margin-left:4.8pt; margin-right:0cm">
<div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Hi,</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US"> </span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">We run FreeSWITCH on Amazon AWS EC2, using the c5.xlarge machine size, meaning 4 CPUs with hyper-threading, sums up to 8 vCpu.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">In time of high-traffic, the system is reaching 100% CPU at about 400 concurrent sessions, which is typically 200 calls (2 sessions per call).</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">RTP is sent as G-711. SIP signaling is this test is UDP (no TCP or other protocols).</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">These numbers are after reducing the log level and moving the core-dsn to memory.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">The dialplan in this test is very simple.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">ulimit values are as recommended in FreeSWITCH documentation.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">On thread level, we see many threads that consume <1.5% CPU. Several threads consume more, apparently the signaling.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US"> </span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Question:</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Do these numbers make sense? We expected to see much more traffic before the CPU is congested.</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Are there simple tricks to reduce the CPU usage (as we did with changing the log level)</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Is there a way to analyze the CPU consumption so we can try and improve?</span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US"> </span><span lang="en-IL"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
<span lang="EN-US">Thanks</span><span lang="en-IL"></span></p>
</div>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 11pt; font-family: Calibri, sans-serif;">
_________________________________________________________________________<br>
<br>
The FreeSWITCH project is sponsored by SignalWire <a href="https://signalwire.com" target="_blank">
https://signalwire.com</a><br>
Enhance your FreeSWITCH install with disruptive priced SMS and PSTN services.<br>
Build your next product on our scalable cloud platform.<br>
<br>
Join our online community to chat in real time <a href="https://signalwire.community" target="_blank">
https://signalwire.community</a><br>
<br>
Professional FreeSWITCH Services<br>
<a href="mailto:sales@freeswitch.com" target="_blank">sales@freeswitch.com</a><br>
<a href="https://freeswitch.com" target="_blank">https://freeswitch.com</a><br>
<br>
Official FreeSWITCH Sites<br>
<a href="https://freeswitch.com/oss" target="_blank">https://freeswitch.com/oss</a><br>
<a href="https://freeswitch.org/confluence" target="_blank">https://freeswitch.org/confluence</a><br>
<a href="https://cluecon.com" target="_blank">https://cluecon.com</a><br>
<br>
FreeSWITCH-users mailing list<br>
<a href="mailto:FreeSWITCH-users@lists.freeswitch.org" target="_blank">FreeSWITCH-users@lists.freeswitch.org</a><br>
<a href="http://lists.freeswitch.org/mailman/listinfo/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/listinfo/freeswitch-users</a><br>
UNSUBSCRIBE:<a href="http://lists.freeswitch.org/mailman/options/freeswitch-users" target="_blank">http://lists.freeswitch.org/mailman/options/freeswitch-users</a><br>
<a href="https://freeswitch.com" target="_blank">https://freeswitch.com</a></p>
</blockquote>
</div>
</div>
</div>
</div>
</body>
</html>