FreeSWITCH Automated Testing
FreeSWITCHers, So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified. Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes. Here are two VERY crude examples: https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0 https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0 Input? -- *Brian West* brian@freeswitch.org *Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> *T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
Very cool! QR trick is clever! On Mon, Jul 27, 2015 at 7:46 PM, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sincerely, Giovanni Maruzzelli Cell : +39-347-2665618
https://twitter.com/briankwest/status/625720099429691393 Has an example of an 8x8 layout with 64 conf callers broadcasting 64 uniq QR codes, 128 sessions in total. :) On Mon, Jul 27, 2015 at 1:04 PM, Giovanni Maruzzelli <gmaruzz@gmail.com> wrote:
Very cool! QR trick is clever!
On Mon, Jul 27, 2015 at 7:46 PM, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- Sincerely,
Giovanni Maruzzelli Cell : +39-347-2665618
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- *Brian West* brian@freeswitch.org *Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> *T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
Thats AWESOME ! :) Well done. On 28 July 2015 at 03:46, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Sincerely Jay
Now we need to start a community project to build on this and drive it forward. :) SEE YOU ALL AT CLUECON! On Mon, Jul 27, 2015 at 5:48 PM, jay binks <jaybinks@gmail.com> wrote:
Thats AWESOME ! :) Well done.
On 28 July 2015 at 03:46, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Sincerely
Jay
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- *Brian West* brian@freeswitch.org *Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> *T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
Brian, I think I had shared already with you the project we started at Sangoma: https://github.com/sangoma/switchy Although the short term goal for the project was scalable load testing, we always kept in mind the ability to perform functional/signaling testing and in fact there's a few. You get 'load-testing' on those functional tests for free. The overall idea is you can run different scenarios simultaneously. I think should be trivial for our guys to replicate your tests as part of the switchy framework. In Python of course :) Feedback from the community will be appreciated. Our QA engineering team will be presenting Thursday at ClueCon. One of the sessions is focused on this project in particular. - Moy On Mon, Jul 27, 2015 at 6:52 PM, Brian West <brian@freeswitch.org> wrote:
Now we need to start a community project to build on this and drive it forward. :)
SEE YOU ALL AT CLUECON!
On Mon, Jul 27, 2015 at 5:48 PM, jay binks <jaybinks@gmail.com> wrote:
Thats AWESOME ! :) Well done.
On 28 July 2015 at 03:46, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Sincerely
Jay
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
We are having a meeting here at ClueCon to discuss all the options and see what requires the least amount of work to integrate these audio/video path verification tests. You'll bee here so I would love to have you in on that when we discuss it. On Mon, Aug 3, 2015 at 1:20 AM, Moises Silva <moises.silva@gmail.com> wrote:
Brian,
I think I had shared already with you the project we started at Sangoma: https://github.com/sangoma/switchy
Although the short term goal for the project was scalable load testing, we always kept in mind the ability to perform functional/signaling testing and in fact there's a few. You get 'load-testing' on those functional tests for free. The overall idea is you can run different scenarios simultaneously. I think should be trivial for our guys to replicate your tests as part of the switchy framework. In Python of course :)
Feedback from the community will be appreciated.
Our QA engineering team will be presenting Thursday at ClueCon. One of the sessions is focused on this project in particular.
-
Moy
On Mon, Jul 27, 2015 at 6:52 PM, Brian West <brian@freeswitch.org> wrote:
Now we need to start a community project to build on this and drive it forward. :)
SEE YOU ALL AT CLUECON!
On Mon, Jul 27, 2015 at 5:48 PM, jay binks <jaybinks@gmail.com> wrote:
Thats AWESOME ! :) Well done.
On 28 July 2015 at 03:46, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
-- Sincerely
Jay
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://wiki.freeswitch.org http://www.cluecon.com
FreeSWITCH-dev mailing list FreeSWITCH-dev@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-dev UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-dev http://www.freeswitch.org
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
-- *Brian West* brian@freeswitch.org *Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch> *T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
Hi All, I have a question. With freeswitch i record video conversations. I use mod_vlc but mod_av generally the same story. With <action application="export" data="record_concat_video=true"/> I write both in one file, and I have CPU load around 25-30 percent. Without this settings, when I write down each stream to a separate file I have about the same workload. It is possible to control the quality of the recording? Change the frame rate, or something like that? How can I improve the performance of that record does not eat off as much CPU time? -- S pozdravem, Ing.Denis Jakovlev mob.tel. 775-415-382
here I started a project for a customer. It validates the SIP message flow for a remote server, sends and receives DTMF, and is intended to be used for automated testing. FreeSWITCH is used as a dialer and a callee, and the remote server can also be... a FreeSWITCH server :) The documentation is not there yet, but it will be finalized during Summer: https://github.com/voxserv/rring Also here is an example of using Sevana AQuA software for comparing the input and output audio. https://github.com/ssinyagin-freeswitch-jira/FS-7805 Also based on FS-7805 experience, I'm making a Perl script which will process the histogram produced by "sox stat -freq", so that it can check if the recorded audio files are identical between each other. It's slower than AQuA, but is completely free and allows to verify the clock precision on the host. I'll be happy if these things also go into your automated test environment (after I finalize them). On Mon, Jul 27, 2015 at 7:46 PM, Brian West <brian@freeswitch.org> wrote:
FreeSWITCHers,
So after a bit discussion, a case of red bull, an approach to automating functional testing has now solidified.
Audio Path is verified via DTMF in-band, Video Path is verified by using QR codes.
Here are two VERY crude examples:
https://www.dropbox.com/s/4fkdcgzo8dt0hdr/conference_test.pl?dl=0
https://www.dropbox.com/s/497rm2hgopp5u7h/eavesdrop_test.pl?dl=0
Input?
--
*Brian West* brian@freeswitch.org
*Twitter: @FreeSWITCH , @briankwest* http://www.freeswitchbook.com http://www.freeswitchcookbook.com
Got Bugs? Report them here <https://freeswitch.org/jira>! | Reddit: /r/freeswitch <https://www.reddit.com/r/freeswitch>
*T:*+19184209001 | *F:*+19184209002 | *M:*+1918424WEST (9378) *iNUM:*+883 5100 1420 9001 | *ISN:*410*543 | *Skype:*briankwest
_________________________________________________________________________ Professional FreeSWITCH Consulting Services: consulting@freeswitch.org http://www.freeswitchsolutions.com
Official FreeSWITCH Sites http://www.freeswitch.org http://confluence.freeswitch.org http://www.cluecon.com
FreeSWITCH-users mailing list FreeSWITCH-users@lists.freeswitch.org http://lists.freeswitch.org/mailman/listinfo/freeswitch-users UNSUBSCRIBE:http://lists.freeswitch.org/mailman/options/freeswitch-users http://www.freeswitch.org
participants (6)
-
Brian West
-
Denis Jakovlev
-
Giovanni Maruzzelli
-
jay binks
-
Moises Silva
-
Stanislav Sinyagin