Installing Kaltura CE 6 (Falcon) from GitHub

Joined: 04/09/2012

Points: 193

Harry, look for newer instructions from Kalturian with updates. This thread has some old news.

Thu, 02/21/2013 - 08:13

Harry_Marschke

Joined: 06/09/2010

Points: 3

Joseph, thx for your immediate response. I have never used GitHub before, so every error message is full of secrects for me. ;o)
I have found your recent post on this behalf meanwhile, and I will give it a try.

Best regards, Harry

Sat, 12/08/2012 - 17:15

Joined: 04/09/2012

Points: 193

So far so good on this install. Just a couple of comments so far...

Base install for me was CentOS 6.3 using Developer profile and then added extras using the graphical installer for items such as php, mysql, etc etc.

Hardware is a new build with Ivy Bridge i7-3770k overclocked, 16gb RAM (I have another 16 if needed to test performance), Asus P8Z77 motherboard.

Since AWS instances of Kaltura are so expensive to run, my goal is to run a local Kaltura instance at home and have the drupal user facing portal running on AWS and connecting to my local Kaltura.

Installer Comments:

1) The prep/prereqs went well. Really, just copy/paste from the instructions into a terminal. Can't get any easier.

2) My GitHub cloning went well after creating and registering the ssh keys.

3) The actual installation script asks me the following question:
Would you like to create a new kaltura database or use an exisiting one? (Y/n)

Huh? You ask if I want A or B but require a Y/N response. I hit Y to move on.

4) just got to the failure for not having a database user created with write perms. I need to fix that then come back to the installer.

I'll provide more feedback later.

Sat, 12/08/2012 - 20:28

Joined: 04/09/2012

Points: 193

edit - solution posted at the bottom of this post.

After installation that didn't appear to throw any errors, I followed the three or four steps such as the /etc/hosts edit, the symbolic link, the apache restart and the domain/start page.

The initial page showing the publisher and admin areas shows up fine.

Entering the admin area throws the following error to an otherwise white browser screen:

"PHP Class map could not be saved"

Any thoughts? In the mean time I'll start trying to find some log files for clues.

Solution to this problem is noted in a github issue

Add a note in the installation README to run this:
sudo chown -R apache:apache /opt/kaltura
before restarting apache.
This was in the video, but left out of the text instructions. I wasted 3 hours trying to fix something with the HostCache file permissions.

Sun, 12/09/2012 - 14:51

Joined: 04/09/2012

Points: 193

Sorry if this is not the appropriate place for this. I'm continuing the notifcation of Falcon thread with install questions.

Can anyone help diagnose the following error messages. Obviously permissions but what and who is the question.

File = admin_console.log

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initLog] DEBUG: starting request

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initNavigation] ERR: Class [KalturaInternalToolsPluginSystemHelperAction] requires permissions [Array

(

    [0] => SYSTEM_INTERNAL

)

]

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initNavigation] ERR: Class [VirusScanListAction] requires permissions [Array

(

    [0] => SYSTEM_ADMIN_VIRUS_SCAN

)

]

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initNavigation] ERR: Class [VirusScanConfigureAction] requires permissions [Array

(

    [0] => SYSTEM_ADMIN_VIRUS_SCAN

)

]

.

.

. a bunch of similar

.

.

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initNavigation] ERR: Class [EventNotificationTemplateConfigureAction] requires permissions [Array

(

    [0] => SYSTEM_ADMIN_CONTENT_DISTRIBUTION_MODIFY

)

]

2012-12-08 23:29:55 [490193144] [InfraBootstrapper->_initNavigation] ERR: Class [EventNotificationTemplateUpdateStatusAction] requires permissions [Array

(

    [0] => eventNotification.SYSTEM_ADMIN_EVENT_NOTIFICATION_MODIFY

)

]

Tue, 12/11/2012 - 18:05

Joined: 04/09/2012

Points: 193

I don't know if my reinstall of 6.0.1 instead of 6.0.0 fixed this or not but somehow after reinstalling this error didn't happen.

Sun, 12/09/2012 - 11:13

#10

milorad

Joined: 02/24/2012

Points: 4

i believe virus scan is added in configuration in admin console after you create a publisher , i've noticed that a my api_v3 log is getting quite large over time and that embedded HTML5 player is not serving video on iphone (the operation could not be completed), also analytics are not working either, now, there was a workaround for CE5 http://blog.ronileco.com/kaltura-ce5-analytics-13/, however this could not be used here as /opt/kaltura/dwh/logs is removed?

Update: I have created etl user with subdirectories logs & events and logs directory in /opt/kaltura/dwh then run scripts from /opt/kaltura/dwh/crontab...this seemed to work now (receiving logs)

Tue, 12/11/2012 - 17:07

#11

Joined: 04/09/2012

Points: 193

FYI -

While listening to the screen-cast I noticed that I was blindly copying the installation commands and didn't realize I should change the version number from 6.0.0 to 6.0.1.

Maybe there could be a note in the docs referring to a list of versions available or something so readers know to at least inquire about the latest version.

Wed, 12/12/2012 - 19:58

#12

Joined: 08/30/2010

Points: 115

I'm getting

fatal: reference is not a tree: 7ebc836ec24e266ae201de7636acf2c30c3f9435
Unable to checkout '7ebc836ec24e266ae201de7636acf2c30c3f9435' in submodule path 'git-repositories/KalturaServer'

as well when running git submodule update --init

Wed, 12/12/2012 - 20:00

#13

Joined: 08/30/2010

Points: 115

also tried to package just for fun I get:

PHP Warning: copy(//sys/devices/platform/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/rtc_cmos/subsystem/devices/serial8250/tty/ttyS0/subsystem/ttyS1/power/wakeup_hit_count): failed to open stream: No such file or directory in /home/ec2-user/ce-packager/installer/lib/utils.php on line 20

and it recursively makes those files

Wed, 12/12/2012 - 20:35

#14

Joined: 08/30/2010

Points: 115

doh ok I have to go into ce-packager/git-repositories directory and doh git clone for each folder
so :
git clone https://github.com/kaltura/KalturaServer.git
git clone https://github.com/kaltura/ce-binaries.git
git clone https://github.com/kaltura/ce-branding.git
git clone https://github.com/kaltura/ce-configurations.git
git clone https://github.com/kaltura/ce-dwh.git
git clone https://github.com/kaltura/ce-uiconfs.git

before I can do
php package.php /home//kaltura-installer false CE v6.0.1 dev

Wed, 12/12/2012 - 20:47

#15

Joined: 08/30/2010

Points: 115

arg now I"m getting:

12.12.2012 20:40:51 INFO Replaced tokens in file /opt/kaltura/app/configurations/url_managers.ini
12.12.2012 20:40:51 ERROR Cannot replace token in file /opt/kaltura/app/batch/monitor/fullstatus.php
12.12.2012 20:40:51 USER Installation failed.
12.12.2012 20:40:51 USER Failed to replace tokens in /opt/kaltura/app/batch/monitor/fullstatus.php

I think kaltura/app/batch/monitor/fullstatus.php is missing
it's not in https://github.com/kaltura/KalturaServer/tree/master/batch/monitor either :(

Wed, 12/12/2012 - 21:42

#16

Joined: 08/30/2010

Points: 115

ok got it >.<

had to add a branch flag for falcon soooo:

git clone https://github.com/kaltura/KalturaServer.git -b falcon
git clone https://github.com/kaltura/ce-binaries.git -b falcon
git clone https://github.com/kaltura/ce-branding.git -b falcon
git clone https://github.com/kaltura/ce-configurations.git -b falcon
git clone https://github.com/kaltura/ce-dwh.git -b falcon
git clone https://github.com/kaltura/ce-uiconfs.git -b falcon

I put it in all of them just in case lol

and remember to :
sudo chown -R apache:apache /opt/kaltura
before restarting apache.

Wed, 12/12/2012 - 23:41

#17

bgavin

Joined: 01/25/2012

Points: 12

Hi Guys,

I'm trying to install CE6 on ubuntu from github, but I'm hitting a bump with the pentaho install. The instructions say:

sudo mkdir /usr/local/pentaho cd /usr/local/pentaho sudo wget http://sourceforge.net/projects/pentaho/files/Data%20Integration/4.2.1-s... sudo tar xzf pdi-ce-4.2.1-stable.tar.gz sudo mv data-integration pdi

But the last line to move data-integration to pdi can't complete because pdi doesn't exist. Am I missing something or should the tar have created the pdi directory?

Thanks,
Brett

Thu, 12/13/2012 - 11:48

#18

WalVSL

Joined: 10/04/2010

Points: 50

The "mv" command is a rename of the old directory name to the new one, so it shouldn't already exist since it becomes the new name. Hope that makes sense...

Thu, 12/13/2012 - 16:00

#19

craig.jamieson

Joined: 03/08/2012

Points: 22

I'm getting the same error as lizardcircus above:

fatal: reference is not a tree: 7ebc836ec24e266ae201de7636acf2c30c3f9435
Unable to checkout '7ebc836ec24e266ae201de7636acf2c30c3f9435' in submodule path 'git-repositories/KalturaServer'

Someone must be playing with the git repositories and killed the reference. It worked without any problems on the weekend. It looks like you can clone all the submodules on your own, as lizardcircus points out above. If you do decide to go that route, there's a 7th submodule you'll want as well:

https://github.com/kaltura/ce-docs.git, but it goes in /packaging/package_skeleton/app/web/content/docs rather than in /git-repositories as the others.

Setting aside the broken git repo, the instructions and screencasts are really great. The copy I was fiddling with over the weekend was working well, even the analytics, which have been flakey in the past.

Thu, 12/13/2012 - 19:29

#20

Joined: 08/30/2010

Points: 115

thanks craig not how do I update my installed kaltura with the ce-docs? I"m having an issue where when I go to check ou tthe entry I get a popup with the title error and an ok box coming up like 16 times I have to click ok 16 time for the edit entry dialog to fully fade back in from black >.<

Sat, 12/15/2012 - 18:42

#21

craig.jamieson

Joined: 03/08/2012

Points: 22

I had better luck just removing the git submodule with the broken reference (KalturaServer) and then re-adding it in manually. Check out this link to learn how to remove a submodule from git. I would try setting everything up again with all the packages and see if that fixes your error.

The only time I seem to get an error box is if I forget to kill and restart searchd. Papyromancer demos this in the screencast, or you can check the instructions here in the section under "Commonly Used Server Administration Commands."

Wed, 01/02/2013 - 14:02

#22

Joined: 01/02/2013

Points: 20

I'm running into a problem installing Kaltura CE v6.0.1 from git hub.

Following the screencasts I have successfully cloned git repos, ran packager and during the installation I get the following error:

Creating and initializing 'kaltura' database

Installation failed.

Failed running database script /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql

Install_log says that:

01.2013 14:03:33 INFO Executing mysql -h127.0.0.1 -uroot -P3306 kaltura < /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql

01.2013 14:03:33 ERROR Executing command failed: ERROR 1062 (23000) at line 1312: Duplicate entry '170555' for key 'PRIMARY'

01.2013 14:03:33 USER Installation failed.

01.2013 14:03:33 USER Failed running database script /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql

And indeed - from what I can see in /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql row with 'id' of 170555 is inserted twice - and 'id' is defined as primary key for the table. (NOTE: I did have old DB leftovers from previous attempt - but according to log they were successfully dropped).

I tried working around it by changing 'id' column of the last row by hand - and then installation succeeds, but after trying to access admin console I'm getting exact same permission errors as described above, namely:

2013-01-02 14:59:40 [902160020] [InfraBootstrapper->_initNavigation] ERR: Class [KalturaInternalToolsPluginSystemHelperAction] requires permissions [Array

(

    [0] => SYSTEM_INTERNAL

)

]

...

I did a couple of reinstalls, both with 6.0.0 (did not have the db population problem) and 6.0.1 - always with the same result. Attaching admin-console.txt output...

Any help would be much appreciated! Thanks!

Attachment	Size
admin-console.txt	9.84 KB

Wed, 01/02/2013 - 14:29

#23

Joined: 01/02/2013

Points: 20

After further investigation I see that permission errors are the results of failed SQL query:

2013-01-02 15:13:34 [0.001100] [127.0.0.1] [429967195] [API] [KalturaStatement->execute] DEBUG: /* kaltura.evionet.pl[429967195][propel] 
*/ SELECT category_kuser.ID, category_kuser.CATEGORY_ID, 
category_kuser.KUSER_ID, category_kuser.PUSER_ID, category_kuser.SCREEN_NAME, 
category_kuser.PARTNER_ID, category_kuser.PERMISSION_LEVEL, category_kuser.STATUS, 
category_kuser.INHERIT_FROM_CATEGORY, category_kuser.UPDATE_METHOD,
 category_kuser.CREATED_AT, category_kuser.UPDATED_AT, 
category_kuser.CUSTOM_DATA, category_kuser.CATEGORY_FULL_IDS, 
category_kuser.PERMISSION_NAMES FROM `category_kuser` WHERE category_kuser.KUSER_ID='102' AND category_kuser.PARTNER_ID='-2' LIMIT 1
2013-01-02 15:13:34 [0.001205] [127.0.0.1] [429967195] [API] [BasePeer::doSelect] ERR: SQLSTATE[42S22]:
 Column not found: 1054 Unknown column 'category_kuser.PERMISSION_NAMES' in 'field list'
2013-01-02 15:13:34 [0.000541] [127.0.0.1] [429967195] [API] [KalturaFrontController->getExceptionObject]
ALERT: exception 'PropelException' with message ' [wrapped: SQLSTATE[42S22]: Column not found: 1054 
Unknown column 'category_kuser.PERMISSION_NAMES' in 'field list']' in /opt/kaltura/app/vendor/propel/util/BasePeer.php:467
Stack trace:
#0 /opt/kaltura/app/alpha/lib/model/om/BasecategoryKuserPeer.php(374): BasePeer::doSelect(Object(Criteria), Object(KalturaPDO))
#1 /opt/kaltura/app/alpha/lib/model/om/BasecategoryKuserPeer.php(277): BasecategoryKuserPeer::doSelect(Object(Criteria), NULL)
#2 /opt/kaltura/app/alpha/lib/model/categoryKuserPeer.php(47): BasecategoryKuserPeer::doSelectOne(Object(Criteria))
#3 /opt/kaltura/app/alpha/lib/model/kuser.php(139): categoryKuserPeer::isCategroyKuserExistsForKuser(102)
#4 /opt/kaltura/app/alpha/lib/model/om/Basekuser.php(2509): kuser->postSave(Object(KalturaPDO))
#5 /opt/kaltura/app/alpha/lib/model/kuser.php(76): Basekuser->save(NULL)
#6 /opt/kaltura/app/alpha/lib/model/UserLoginDataPeer.php(457): kuser->save()

My SQL DB Kaltura does have a category_kuser table without the PERMISSION_NAMES field.

Is there a version mismatch between PHP constructed queries and DB-populating scripts?

Wed, 01/02/2013 - 16:29

#24

fls

Joined: 04/27/2012

Points: 2

i am running into the same situation on a new centos63 installation:

Creating and initializing 'kaltura' database

Installation failed.

Failed running database script /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql

Thu, 01/03/2013 - 14:22

#25

seraphin.miranda

Joined: 05/14/2012

Points: 51

I have exactly the same problem of m.zajakala and fls on CentOS 6.3 with CE 6.0.1

Thu, 01/03/2013 - 16:06

#26

Joined: 01/02/2013

Points: 20

If this helps anybody - I know the root of the problem... Seems (according to git log) that there has been a recent change in sql query making use of newly added PERMISSION_NAMES column - and this is not yet reflected in SQL scripts creating the DB.

I switched git branch of the KalturaServer repo to falcon-working (very optimistically named :-) ) and this solved the problem - the branch does not have the new changes commited yet.

I managed to finish the installation and get the CE server running... time to click around a litlle :)

Thu, 01/03/2013 - 17:39

#27

seraphin.miranda

Joined: 05/14/2012

Points: 51

Like m.zajakala said I changed the KalturaServer repo to falcon-working branch and the problem with the database was solved :)

Thanks ^^

Sun, 01/06/2013 - 04:13

#28

Joined: 04/09/2012

Points: 193

Regarding reply #2, which branch should I use for a relatively stable Falcon release
https://github.com/kaltura/ce-packager/network
Falcon
Falcon-Latest
Falcon-Working

While using the "Falcon" branch I am getting the "fatal: reference is not a tree" error. Somehow I had success on an earlier build.

Sun, 01/06/2013 - 04:09

#29

Joined: 04/09/2012

Points: 193

After a clean build a while back on Falcon it seems recent github changes have caused a couple of serious failures. Going back to Falcon-Working seems to miss a lot of changes that we may want.

Maybe the developers don't visit here often.

I created two issues in the issue log for the "database error" and the "fatal: reference is not a tree" errors.

In the mean time I am going to give the gemini branch a run.

Sun, 01/06/2013 - 23:57

#30

Joined: 12/18/2012

Points: 66

Where is the documentation about the different dot releases? ie. v6.0.0 and v6.0.1?

Mon, 01/07/2013 - 01:56

#31

Joined: 12/18/2012

Points: 66

The two errors I keep getting are:

07.01.2013 06:02:19 ERROR Executing command failed: chmod  0777 -R /opt/kaltura/tmp
07.01.2013 06:02:19 ERROR Output from command is:
07.01.2013 06:02:19 ERROR End of Output
07.01.2013 06:02:19 USER Creating and initializing 'kaltura' database
07.01.2013 06:02:19 INFO Creating database kaltura
07.01.2013 06:02:19 INFO Executing mysql -h127.0.0.1 -uroot -P3306 kaltura < /opt/kaltura/app/deployment/final/sql/01.kaltura_ce_tables.sql
07.01.2013 06:02:20 INFO Executing mysql -h127.0.0.1 -uroot -P3306 kaltura < /opt/kaltura/app/deployment/final/sql/02.kaltura_ce_data.sql
07.01.2013 06:02:20 ERROR Executing command failed: ERROR 1062 (23000) at line 1312: Duplicate entry '170555' for key 'PRIMARY'

I'm guessing the chmod error isn't fatal but the mysql primary key one is.
What combination of main branch / submodule branches / v6.0.? is currently recommended? I am unable to get anything working at present.

Mon, 01/07/2013 - 02:40

#32

Joined: 04/09/2012

Points: 193

It's been tough for me lately too. I finally got a build to work using:

edit - oh, I had to rm -rf * on all three of the ~/cd-packager, ~/kaltura-installer and /opt/kaltura directories first.

cd ~/
git clone -b falcon https://github.com/kaltura/ce-packager.git
cd ce-packager

cd git-repositories
git clone -b falcon https://github.com/kaltura/KalturaServer.git
git clone https://github.com/kaltura/ce-binaries.git
git clone https://github.com/kaltura/ce-branding.git
git clone https://github.com/kaltura/ce-configurations.git
git clone https://github.com/kaltura/ce-dwh.git
git clone https://github.com/kaltura/ce-uiconfs.git

cd KalturaServer
git checkout `git rev-list -n 1 --before="2012-12-19" falcon`
cd ../ce-binaries
git checkout `git rev-list -n 1 --before="2012-12-19" master`
cd ../ce-branding
git checkout `git rev-list -n 1 --before="2012-12-19" master`
cd ../ce-configurations
git checkout `git rev-list -n 1 --before="2012-12-19" master`
cd ../ce-dwh
git checkout `git rev-list -n 1 --before="2012-12-19" master`
cd ../ce-uiconfs
git checkout `git rev-list -n 1 --before="2012-12-19" master`
cd ../..
git checkout `git rev-list -n 1 --before="2012-12-19" falcon`

cd packaging
php package.php /home/jjflynn22/kaltura-installer false CE v6.0.1 dev

cd ~/kaltura-installer
sudo php install.php

Mon, 01/07/2013 - 02:47

#33

Joined: 12/18/2012

Points: 66

thanks I'll give that a try

Mon, 01/07/2013 - 04:48

#34

Joined: 12/18/2012

Points: 66

Thanks jflynn22, it is looking good so far.
I just needed one more thing post-install I thought I should put here for other users:

sudo chown -R apache:apache /opt/kaltura/

Cheers

Mon, 01/07/2013 - 04:58

#35

happydust

Joined: 12/05/2012

Points: 2

jflynn22 .I use to try about your suggestion but when I run the command
git checkout `git rev-list -n 1 --before="2012-12-19" falcon`
It take an error like this

[root@localhost git-repositories]# cd KalturaServer
[root@localhost KalturaServer]# git checkout `git rev-list -n 1 --before="2012-12-19" falcon`
Note: checking out 'fe53ffb9bb36be88c040b230416f604062e52778'.

You are in 'detached HEAD' state. You can look around, make experimental
changes and commit them, and you can discard any commits you make in this
state without impacting any branches by performing another checkout.

If you want to create a new branch to retain commits you create, you may
do so (now or later) by using -b with the checkout command again. Example:

git checkout -b new_branch_name

HEAD is now at fe53ffb... fwr: Set NON-APPLICABLE flag for audio-only cases

What's the matter ? Can you help me ?

Fri, 02/08/2013 - 10:13

#36

darren_5

Joined: 02/07/2013

Points: 8

Anyone managed to use this recently? Just tried on a fresh system and getting application errors when trying to hit the site.

Could do with some help getting something running if anyone has the time or inclination.

Thanks

Fri, 02/22/2013 - 08:45

#37

Harry_Marschke

Joined: 06/09/2010

Points: 3

Receiving data from GitHub works fine with one exception: There is no KalturaServer folder to clone. I changed the path to KalturaServerCore.

Running the package.php runs into an error: At first I got a message about missing svn. After installing svn, the script requires me to enter the password of svnread@kelev.kaltura.com...

Any help is appreciated!!

tia Harry

edit: The svn call seems to reside in the included installer/lib/utils.php. I got an error message first when I run the package.php that lib/utils.php was missing. /installer/lib/utils.php was the one I found in the downloaded stuff, so I changed the path in the package.php. Was this correct?

Attachment	Size
utils.php_.txt	9.06 KB
package.php_.txt	5.87 KB

Fri, 02/22/2013 - 19:09

#38

Kalturian

Joined: 01/05/2009

Points: 1697

You should follow the guidelines on: https://github.com/kaltura/ce-packager/issues/35

Mon, 04/22/2013 - 12:55

#39

nic.hart

Joined: 02/03/2013

Points: 5

same story as ever, here: (building to day, 2013-04-22)

following:
git clone https://github.com/kaltura/ce-packager.git
cd ~/ce-packager/
git submodule update --init

fatal: reference is not a tree: b067da1a1a02f68db989399fb7c05b666d7ed3b1
Unable to checkout 'b067da1a1a02f68db989399fb7c05b666d7ed3b1' in submodule path 'git-repositories/KalturaServer'

If the script is _expected_ to fail here, then update the guide to say so?

I'll happily follow the (many) suggestions of which branch and version to try next - but I'd rather be able to rely on the (very recent) advice from a member of the developer team...!

And - the hard-coded version in the last line of the git download:
'git checkout f79d56cd9026e2474ef82f2c7a39ee8f43a2c7ee' - is that being updated/going to be updated to keep up with fixes?

thanks

Mon, 04/22/2013 - 13:02

#40

Joined: 04/09/2012

Points: 193

Halt on following many of these workarounds. The latest info is posted in an instructional thread on the github page.

Start with these instructions https://github.com/kaltura/ce-packager/issues/35

The error isn't the end of the world as the next step or two in the process corrects it.

Mon, 01/07/2013 - 09:58

#41