EVERYDAY JUNGLIST
login
username:

password:

remember me:
free signup!
search
search:

search string:


EDJ TV/Radio Status Launch

Live on EDJradio
online ( Prerecorded )

Audio Streams: 8
Video Streams: 0
Total Locked: 8
online
visitors: 11
birthdays
sideffect8 (34)
forum talk
in: FRENZI 22 - Tha...
by: Chris T
in: EDJ Radio 3.0...
by: kdh
in: EDJ Radio 3.0...
by: kdh
in: 2012 Irrelevant...
by: Guido
in: EDJ Radio 3.0...
by: Guido
stats
visits: 894,934
plays: 60,032
artists: 906
listeners: 437
our sponsors
advertise with us


Your Advertisement could be here! Contact Us today!

Community Forum  » General Discussion  » "EDJ Radio 3.0 Devlopment thread. "
 / 2

kdh
11/17/11 12:05:42
posts: 9,372
junglism messiah
EDJ Radio 3.0 Devlopment thread.
2.0 code has been running for almost a full year with almost not changes, or updates. Its been pretty stable and seemless to the website.

You can see the build log here:

http://www.everydayjunglist.org/forum/General_Discussion/Atten_EDJ_Radio__TV_DJs._Request_for_feedback%2C_features_and_enhancements%21_1264905518

If there is a feature you want, let me know and I'll try to fit it in.

Features:

HTLM5 h264 Public facing Stream w/ backwards compatibilty for FLASH.
Saving the Streams in h264/mp3 AVI format.
Finally get the god damn audio and video in sync. DONE
Upgrade to VLC 1.1.X Code DONE
Have a "Preview Mode" for live shows. You can Preview your video feed before going live. Making sure the Video/Audio looks and sounds right. DONE
Iphone Streaming.

I'll add to the list as I get requests to add them.

I've started to really work on EDJ/LSM Code 3.0 over the last few days.

Version 3.0 is yet again.. Another complete rewrite of the 2.0 code. doh.

2.0 Background Code was rewritten in 98% Perl. There is still 1 bash script I got lazy and left. Meh. Anyway, the 2.0 code runs pretty much out of a single perl script that was split into functions with-in that single script. All user definable variables were with-in that script. While I thought this was a big win, it was also a huge chink in the armor as to how it works. Anytime there was a bug fix, or something went side ways, it required a complete restart of all audio and video services. Lets say we had 10 people in the audio feed, and the video feed ate shit and died.. well.. I'd have to boot the 10 listeners connected to the audio feed to fix the video feed. The other main issue is you can only run 1 instance of the audio/video code on 1 server. Why is this bad?

Lets say we decide to whore out EDJ/LSM code. It doesn't make sense to run the code on a single server when we know we can host multiple web-servers on a single host. It makes more sense to run the same code multiple times on the same server, with out stomping on itself running multiple streams.

Its basic math.. Why spend 300$ a month on 3 servers, when you can run the same code 3 times on 1 server for 100$ while servering up 3 differnt audio/video feeds. Right?

ANYWAY..

I've been writing code in my head for about 6 months. I just need to get it down and written.

So here is where I am at:

11/17/2011

I've spend the last 4 days banging my face on the desk getting VLC 1.1.2, FFMPEG 8.X, and X264 compiled on the new server. I custom compiled them because I removed a bunch of features that we will not use, and also made it so I can just tar up my build dirs, move them to another server, recompile them and redeploy them.

I'm calling each audio/video feed an Instance. So there will be an EDJ Instance, Test Instance, and Development Instance.

An Instance can be a Customer feed as well. Example EDJ Instance, Teknosounds Instance.

Hope I explained the term "Instance" enough to make sense.

Started working on my MasterControl script. This script is the script that will build, stop and start an instance. The idea behind this guy it to just be really high level. It'll look for an instance, start the instance with the instances own config file, and then makes sure that instance stays online, or shuts it down. It will also look for trigger files that have enough information in them to build and create a new instance on the fly.

Started working on my InstanceControl script. This script will control all the bits and peices tied to an instance. IE, Starting the Audio/Video Feeds, playing live content when we have a live show, and playing prerecorded content when we don't have a live show.

The instance control script will work like a scheduler script, calling small micro programs to do all the work. So when I start a live show, instead of having all the STARTLIVESHOW code in the InstanceControl Script, I'll just have a script called Startliveshow. The idea behind this, is if there is a bug in the Startliveshow script, I can just fix it, with out having to take the whole instance down.

Thats about it for now.


11/28/2011

I got a lot done tonight.

I spent the last 4 hours working on some of the ground work.

At this point, I can create a new shoutcast server, and transcoder on the fly.
I can also see if an instance of a shoutcast server took a dive, and if its down, restart it.

It doesn't sound like much, but still working out flow and details. Things are coming along very nicely at this time.

A this point there is a very high level master script that monitors all instances. Each Instance has the ability to run its own code base. I split out major functions like seeing if shoutcast is up or down, into a worker script. this allows me to fix bugs in the system with out having to completely shutdown the master script or instance scripts.

Got a loooong ways to go.

11/29/2011

Lot done tonight.

This doesnt sound like much, but I can on the fly build a brandnew shoutcast config and vlc config with input from a config file. this means when we have a new instance that goes online, JC provides me a config file with some basic information. 5 seconds later a new shoutcast server, and vlc config is now running. There are some slight tweaks that'll need to be done but that part is pretty much done. uh, now that i think about something.. i have to change some stuff. meh.

Im also able to check the status of shoutcast dnas, transcoder and the vlc mosaic service to see if they are online or not, and then start them.

also tweaked the shit out of vlc. here currently on edj we have a bunch of VLC process that make EDJTV happen depending on whats going on, it could be 8 or 9. I trimmed it down now to only 1, and 4 tops for back end recording.

got a long way to go. still a LOT of ground work left to do.

11/30/2011

SO.. I was right.. I talked with JC today and I had to make some minor code changes. BUT.. I think this will enable for features for future folks.

I Finalized the following code blocks:

Check to See if ShoutCast DNAS is oneline
Check to See if SHoutCast TRanscoder is online
Check to see if VLC Stream is online
Start/Restart Shoutcast DNAS
Start/Restart Shoutcast Transcoder
Start/Restart VLC

If the shoutcast module is enabled, then have the VideoStreamer auto pipe in the Shoutcast Feed.

The start/restart code blocks took some time because I wanted to make sure I didn't have duplicate processes running. There have been times where the Transcoder is running twice and it causes issues. Meh.

Doesn't sound like much but it was about 3 1/2 hours of work.

I need to add in stopping various functions, and then I need to add in the ability to do live shows.

One thing I forgot to mention, the Winamp Plug in will no longer be supported. Clients will only use VLC to stream to us going forward.


04/20/2012 11pm

Need a 5 minute break.. But here is where I am at..

Took me a little while to figure out where I left off. I got is set and started running with thins.

I first cleaned up the logging that needed to be there FIRST, before I started any new functions. Once that was completed I added the following Functions.

Status Check ShoutCast DNAS
Status Check ShoutCast Transcoder
Status Check VLC
If any of the above 3 processes die, they are auto restarted, unless they are disabled via a trigger file. They restart once the trigger file goes away.
Stop/Start Shoutcast DNAS
Stop/Start ShoutCast Transcoder


Started the startlive show module. So far it starts the UDP listener, and then the audio only recording.

I ordered my pizza.. need to sit for a bit.. next update in a few hours.


4/21/2012 4:30pm update 1.

I've been eating left over pizza, and drinking hazzel nut ice coffee with chocolate milk..

Ive been working on this for 5 hours.. i need a break.. but here is what I have done.

Worked a lot on flow and got most of it down.

Startlive show function is complete. User logs in, clicks the start live show, and the system then waits for the incoming feed.
Once feed is detected, there is a period of stability testing. Meaning, I've seen "good" feeds come in, and then 10 seconds later they drop. This function watches the feed for a few extra seconds and deems it good. Less chance of a false possitive.
PREVIEW MODE! HA... So if in the old system, when you connected, you were auto connected to the main feed. You had no idea how things sounded, or looked... you just sorta hoped for the best. Preview Mode allows you to Preview what the servers see's on your own machine with out breaking into the live main feed. If you like the angle, and the audio, you can then switch into the main feed when you are ready!
Server side audio recording is complete.
Stopping and starting various functions via a single command is complete.

I am making good progress.. But Long ways to go.

4/21/2012 7:00 pm update 2.

A few peices of left over pizza and small amount of coffee left.. o_0

2 1/2 hours.. need a break.. but here is where I'm at.

Server side Video recording is complete.
Stopping Shoutcast Transcoder when a live feed comes in is done
Restarting Shoutcast Transcoder when the live show is done
Added show scheduler tracking, so if so a user goes long, system will kick show and revert it back to prerecorded content.
Added Kick request, so if admin doesnt like show.. admin can kick show.
Added more logging, including how much time a user has left in thier show if they are live.

4/22/2012 12:30am update 1.

Pizza is all gone.. realized I have a lot of iced coffee, but no chocolate milk.. Guess im stuck with regular milk tomorrow. =/

Ironed out Audio Feed being piped into the video feed from shoutcast when no live show is there.
Worked on Flow and timing.
Finished up restarting Shoutcast once the Live feed drops away.
Finished up starting Shoutcast Audio when things do an inital startup.
Forgot to note this, Audio and Video Feeds are now 100% INSYNC!! Fuck yeah.

For whatever reason, the main video feed looks kinda meh.. Need to figure out why...
still have a ways to go.

been at this non-stop for the last 13 hours.. i got mind melt.. time for bed.

4/23/2012

Didn't get much done. But got some key points completed.

I added a preview mode, but forgot to add the "cancel preview mode".. So I added that. Also made it so preview mode will run as long as the show time is alloted.. so if a user has a 1 hour show, and they stay in preview mode the whole time.. they fucked up and lost thier show. Also added it so if the user does NOT like the preivew, they can cancel it.
Changed the way files get recorded to the serer. Now JC hands me a path, and if the path isn't there, I just create it.

got a ways left to go. lots of little bits on the EDJ site that are hardcoded into the system that I need to port over.. IE, getting listener counts from video player and shoutcast, updating whats playing in the video feed.. stuff like that.

4/27/2012

Forgot to post this last night.

Finalize the Adhoc streaming system.

But ran into an issue.

My main video feed looks like shit, and cant figure out why. Need to play with it or recompile some shit. meh.

5/19/2012

AND I GOT IT WORKING! I thought it was going to take me hours.. Just an issue with VLC 1.1.2, but saved my notes from 1.1.2 and used them the compile VLC 1.1.9, newer version of x264, the 6.5 release of FFMPEG and it looks better.

But now another issue.. Picture looks god damn flawless.. but fast moving video causes the sound to break up.. wtf.

5/20/2012

Got a lot done.

Think I got the audio break issue resolved. Can't really tell. We'll see in a few days tho. Seems to have to do something with the entire camera being moved around. IE grab the camera and shake it like crazy and the audio breaks up. If I just leave it alone and move around and just normal DJ it looks and works fine.

Also worked on getting title updates on the live video feed working. You know, when something precorded is playing, telling you what it is.

then showing a clean video feed when the show is live.

Then going back to showing you what is currently playing.

Added back the XML file that JC uses for website status and stuff.








(post modified: 05/20/12 18:43:49)

kdh
11/28/11 23:08:43
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
11/28/2011

I got a lot done tonight.

I spent the last 4 hours working on some of the ground work.

At this point, I can create a new shoutcast server, and transcoder on the fly.
I can also see if an instance of a shoutcast server took a dive, and if its down, restart it.

It doesn't sound like much, but still working out flow and details. Things are coming along very nicely at this time.

A this point there is a very high level master script that monitors all instances. Each Instance has the ability to run its own code base. I split out major functions like seeing if shoutcast is up or down, into a worker script. this allows me to fix bugs in the system with out having to completely shutdown the master script or instance scripts.

Got a loooong ways to go.

kdh
11/29/11 23:13:18
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
11/29/2011

Lot done tonight.

This doesnt sound like much, but I can on the fly build a brandnew shoutcast config and vlc config with input from a config file. this means when we have a new instance that goes online, JC provides me a config file with some basic information. 5 seconds later a new shoutcast server, and vlc config is now running. There are some slight tweaks that'll need to be done but that part is pretty much done. uh, now that i think about something.. i have to change some stuff. meh.

Im also able to check the status of shoutcast dnas, transcoder and the vlc mosaic service to see if they are online or not, and then start them.

also tweaked the shit out of vlc. here currently on edj we have a bunch of VLC process that make EDJTV happen depending on whats going on, it could be 8 or 9. I trimmed it down now to only 1, and 4 tops for back end recording.

got a long way to go. still a LOT of ground work left to do.

MedicineMan
11/30/11 01:50:39
posts: 2,188
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
^^wow man keep up all the great work Kurt!!

kdh
11/30/11 23:19:16
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Thanks Tom.

11/30/2011

SO.. I was right.. I talked with JC today and I had to make some minor code changes. BUT.. I think this will enable for features for future folks.

I Finalized the following code blocks:

Check to See if ShoutCast DNAS is oneline
Check to See if SHoutCast TRanscoder is online
Check to see if VLC Stream is online
Start/Restart Shoutcast DNAS
Start/Restart Shoutcast Transcoder
Start/Restart VLC

If the shoutcast module is enabled, then have the VideoStreamer auto pipe in the Shoutcast Feed.

The start/restart code blocks took some time because I wanted to make sure I didn't have duplicate processes running. There have been times where the Transcoder is running twice and it causes issues. Meh.

Doesn't sound like much but it was about 3 1/2 hours of work.

I need to add in stopping various functions, and then I need to add in the ability to do live shows.

One thing I forgot to mention, the Winamp Plug in will no longer be supported. Clients will only use VLC to stream to us going forward.

Guido
12/01/11 11:08:39
posts: 4,500
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
&

Damn, that's a bit of coding.
Conceptually, it sounds modular and that equals bad ass.

jSANE
12/01/11 22:04:10
posts: 1,643
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
I finally just got my brand spankin' new lappy and would like to jump on sometime next week.
I will be unable to do a show ritually until sometime in late january due to my departure to job corps.

But I would like get on a dead day sometime soon as I leave on the 12th.


(post modified: 12/01/11 22:04:57)

kdh
12/01/11 23:52:47
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
I finally just got my brand spankin’ new lappy and would like to jump on sometime next week. I will be unable to do a show ritually until sometime in late january due to my departure to job corps. But I would like get on a dead day sometime soon as I leave on the 12th.


sure just msg guido, myself or jc.. all of us can set it up. jsut give us a few hours notice.

jSANE
12/02/11 09:37:56
posts: 1,643
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Awesome. I'll let one of yall know by monday what day and time will work for me.

Guido
12/04/11 15:03:29
posts: 4,500
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Whirred!

I'll be here.
Hit me on AIM and shiznit.

kdh
04/20/12 10:04:19
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Guess who sucks...

This guy right here.

Lots of things have gotten in front of this work.. But Honey will be out of town this weekend.

Tonight 4/20/2012, while every is out smoking weed.. I'm going to order a pizza, pour myself an ice coffee, and I'm going to program till my eyes fall out of my head.

I have 72 hours and I think I can do it.

Check this space for more details later.

kdh
04/20/12 15:07:50
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
OK..

I worked a lot this week, so the boss man sent me home.

SO IT BEGINS. Check this space every few hours for updates.

junglist247365
04/20/12 18:20:19
posts: 2,844
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
ready set go..

kdh
04/20/12 22:08:03
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
04/20/2012 11pm

Need a 5 minute break.. But here is where I am at..

Took me a little while to figure out where I left off. I got is set and started running with thins.

I first cleaned up the logging that needed to be there FIRST, before I started any new functions. Once that was completed I added the following Functions.

Status Check ShoutCast DNAS
Status Check ShoutCast Transcoder
Status Check VLC
If any of the above 3 processes die, they are auto restarted, unless they are disabled via a trigger file. They restart once the trigger file goes away.
Stop/Start Shoutcast DNAS
Stop/Start ShoutCast Transcoder


Started the startlive show module. So far it starts the UDP listener, and then the audio only recording.

I ordered my pizza.. need to sit for a bit.. next update in a few hours.


(post modified: 04/21/12 23:26:45)

kdh
04/21/12 15:37:06
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
4/21/2012 4:30pm update 1.

I've been eating left over pizza, and drinking hazzel nut ice coffee with chocolate milk..

Ive been working on this for 5 hours.. i need a break.. but here is what I have done.

Worked a lot on flow and got most of it down.

Startlive show function is complete. User logs in, clicks the start live show, and the system then waits for the incoming feed.
Once feed is detected, there is a period of stability testing. Meaning, I've seen "good" feeds come in, and then 10 seconds later they drop. This function watches the feed for a few extra seconds and deems it good. Less chance of a false possitive.
PREVIEW MODE! HA... So if in the old system, when you connected, you were auto connected to the main feed. You had no idea how things sounded, or looked... you just sorta hoped for the best. Preview Mode allows you to Preview what the servers see's on your own machine with out breaking into the live main feed. If you like the angle, and the audio, you can then switch into the main feed when you are ready!
Server side audio recording is complete.
Stopping and starting various functions via a single command is complete.

I am making good progress.. But Long ways to go.


(post modified: 04/21/12 23:26:33)

kdh
04/21/12 18:20:41
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
4/21/2012 7:00 pm update 2.

A few peices of left over pizza and small amount of coffee left.. o_0

2 1/2 hours.. need a break.. but here is where I'm at.

Server side Video recording is complete.
Stopping Shoutcast Transcoder when a live feed comes in is done
Restarting Shoutcast Transcoder when the live show is done
Added show scheduler tracking, so if so a user goes long, system will kick show and revert it back to prerecorded content.
Added Kick request, so if admin doesnt like show.. admin can kick show.
Added more logging, including how much time a user has left in thier show if they are live.


(post modified: 04/21/12 23:27:01)

kdh
04/21/12 23:32:54
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
4/22/2012 12:30am update 1.

Pizza is all gone.. realized I have a lot of iced coffee, but no chocolate milk.. Guess im stuck with regular milk tomorrow. =/

Ironed out Audio Feed being piped into the video feed from shoutcast when no live show is there.
Worked on Flow and timing.
Finished up restarting Shoutcast once the Live feed drops away.
Finished up starting Shoutcast Audio when things do an inital startup.
Forgot to note this, Audio and Video Feeds are now 100% INSYNC!! Fuck yeah.

For whatever reason, the main video feed looks kinda meh.. Need to figure out why...
still have a ways to go.

been at this non-stop for the last 13 hours.. i got mind melt.. time for bed.

Guido
04/22/12 10:28:17
posts: 4,500
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.

Well, it sounds like the mechanics of the site are solidly developed.

Extra bonus points for 100% sync on Audio & video feeds. I'm sure that was no easy task.


I know these aren't your side of the house Kurt, but here's some things I think we need on the site:

- A Send Message button(for Private Messages) on someone's profile. (if you already found their profile and you're logged in)
- Retweak alphabetical sorting when browsing the profiles.
- Forums, a "Next Page," " Previous Page," "First Page" and "Last Page" button both at the top and at the bottom for quicker navigation.

I'm sure I'll come up with a few more, but these are kind of my first and priority feedback for 3.0 development of the user interface.

kdh
04/23/12 12:09:07
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Thanks guido, thats more logan and jon. but they read this thread so they should see it.

I met up with Jon yesterday, showed him what I have done. Good stuff, but there is still more work that needs to be done, and will be done tonight. I plan to shift this code to the main EDJ server here soon for beta testing.

kdh
04/23/12 20:43:39
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
4/23/2012

Didn't get much done. But got some key points completed.

I added a preview mode, but forgot to add the "cancel preview mode".. So I added that. Also made it so preview mode will run as long as the show time is alloted.. so if a user has a 1 hour show, and they stay in preview mode the whole time.. they fucked up and lost thier show. Also added it so if the user does NOT like the preivew, they can cancel it.
Changed the way files get recorded to the serer. Now JC hands me a path, and if the path isn't there, I just create it.

got a ways left to go. lots of little bits on the EDJ site that are hardcoded into the system that I need to port over.. IE, getting listener counts from video player and shoutcast, updating whats playing in the video feed.. stuff like that.

kdh
04/27/12 19:16:06
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
4/27/2012

Forgot to post this last night.

Finalize the Adhoc streaming system.

But ran into an issue.

My main video feed looks like shit, and cant figure out why. Need to play with it or recompile some shit. meh.

kdh
05/09/12 07:55:24
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Lost a little steam..

Honey goes out of town on Monday for 4 days.. I should have a fully working Beta by Tuesday.


Guido
05/09/12 10:49:46
posts: 4,500
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
This week has been nuts for me at work.

it's cool to drop back a little bit. I've been leaving completely drained, get home and just want to unplug.
Next week is supposed to be more of the same for me. Not exactly looking forward to it.

kdh
05/19/12 14:23:34
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Honey has some stuff that she's working on, so I figured I tackle some small odds and ends today.

Namely.. Recompile VLC... There is an issue for what ever reason with it running in multi-feed mode. The picture looks like shit. So I'm going to recompile with a newer version and see if that fixes it.

Compile hell... Here I come.

kdh
05/19/12 16:20:52
posts: 9,372
junglism messiah
Re: EDJ Radio 3.0 Devlopment thread.
Honey has some stuff that she�s working on, so I figured I tackle some small odds and ends today. Namely.. Recompile VLC... There is an issue for what ever reason with it running in multi-feed mode. The picture looks like shit. So I�m going to recompile with a newer version and see if that fixes it. Compile hell... Here I come.


AND I GOT IT WORKING! I thought it was going to take me hours.. Just an issue with VLC 1.1.2, but saved my notes from 1.1.2 and used them the compile VLC 1.1.9, newer version of x264, the 6.5 release of FFMPEG and it looks better.

But now another issue.. Picture looks god damn flawless.. but fast moving video causes the sound to break up.. wtf.


(post modified: 05/19/12 16:21:28)
 / 2

! You must be logged in to post a forum entry!   click here to log in