Kaltura analytics page

8 replies [Last post]

Wed, 08/12/2009 - 11:58

Joined: 05/26/2009

Points: 2

Hello.

I'm a developer and i'm using Kaltura API for uploading and tracking videos, now i want to use Kaltura API to create "Kaltura Analytics" page and add it into my website:

1- Is that available ?
2- Is kaltura API for the analytics page available now for production ?, If so, could you give me some links for its documentation so i can find some examples/samples ?
3- Is it a free service ? or i have to pay for using it ?

Thanks in advance.
Emad.

Wed, 08/12/2009 - 13:36

Kalturian

Joined: 01/05/2009

Points: 1697

Hi,

Yes, Kaltura provides full analytics services based on our own data warehouse.
Yes, Reporting and Analytics are being represented on the API as well, this will be soon exposed on the hosted service and a public demo will be made available. There is no documentation yet, in order to enable analytics on your account you should contact our professional services and upgrade to the latest KDP version (the one available via application studio today).
This is a hosted edition service only at the moment, you can only get analytics if you use the hosted edition. So in a way, yes - you should be a paying customer of the hosted/enterprise edition or be using the hosted edition on the latest player version, and contact professional services to enable this service for your partner.

What would you like to develop on top of the analytics API?

Wed, 10/21/2009 - 15:39

jeff

Joined: 06/29/2009

Points: 93

http://corp.kaltura.com/technology/video_management

Quote:

Kaltura's Video Management Console (KMC) provides publishers with a complete set of tools for content and video management. Our Open Sourece Video Platform's management console lets publishers gain maximum control over media management and widget configuration, and thorough visibility of video usage via detailed analytics.

So, to get this open source analytics in the KMC you have to get a hosted version? Will analytics be released in the CE version? (the GUI for the backend, the api is there...)

---Jeff

Wed, 10/28/2009 - 09:05

IdoSet

Joined: 03/29/2009

Points: 764

The analytics in the KMC will be a part of the enterprise edition.

Fri, 11/13/2009 - 22:26

anointed

Joined: 05/27/2009

Points: 23

Does this mean there is no statistics built into the community edition?
(I don't know myself, because the ce server is being installed onto my system as I write this)

If not, how much does it cost to purchase the stats module so I can add it to my ce install?

I have already talked to sales in the past, and I am not a good candidate for the enterprise edition. After much discussion it became apparent that your bw/storage charges were nowhere near what I currently pay for either my colo'd servers or my vps.net cdn setup.
(I pay about 2cents/GB transfer on my colo boxes, which have 128TB of storage, and 5cents/GB transfer with vps.net using the highwinds cdn - (one of the better ones out there).

I just seem to end up fighting the exact same battle with every piece of video software so far. Everything is there but the stats....

In my case, I run wordpress-mu and have multiple client sites on the same install. Using the all-in-one video plugin will make it easy for my customers to upload their content, but I need a way of tracking their storage and bw usage. Otherwise the software is pretty much useless in my case.

Is there a ce solution that I may just not be aware of?

Tue, 11/17/2009 - 11:44

IdoSet

Joined: 03/29/2009

Points: 764

No, there isn't. It will be included only in the enterprise edition. For costs and additional details, you are welcome to contact our sales department (pm me if you don't have the mail address).

Mon, 01/31/2011 - 11:10

exxplain

Joined: 08/10/2010

Points: 167

analytics doesn't work!

Mon, 01/16/2012 - 14:05

neuron005

Joined: 10/05/2011

Points: 51

Hii
I can get some of the analytics leaving bandwidth_usage on my KCE4 ! Does kaltura miss tables while installing dwh?
Thanks

Tue, 01/17/2012 - 13:58

neuron005

Joined: 10/05/2011

Points: 51

Hii I checked my logs and there are no errors. I can not understand output of my log file. Please tell me about these variables as how do they work. My log output is as:
2012/01/02 05:30:25 - WWW bandwidth usage cycle process - Starting entry [Set Main Variables] 2012/01/02 05:30:25 - WWW bandwidth usage cycle process - Starting entry [generate_cycle] 2012/01/02 05:30:25 - Get files and generate cycle - Starting entry [Validate process exists in DB] 2012/01/02 05:30:25 - Validate process exists in DB - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/validate_process_in_DB.ktr] 2012/01/02 05:30:25 - Validate process in DB - Dispatching started for transformation [Validate process in DB] 2012/01/02 05:30:25 - Validate process in DB - This transformation can be replayed with replay date: 2012/01/02 05:30:25 2012/01/02 05:30:26 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Set Variables.0 - Setting environment variables... 2012/01/02 05:30:26 - Set Variables.0 - Set variable ProcessName to value [bandwidth_usage_WWW] 2012/01/02 05:30:26 - Find process in DB.0 - Finished processing (I=1, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Filter rows.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Set Variables.0 - Finished after 1 rows. 2012/01/02 05:30:26 - Set Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Get files and generate cycle - Starting entry [get files] 2012/01/02 05:30:26 - fetch_www_files - Starting entry [Set Temp Storage Location] 2012/01/02 05:30:26 - fetch_www_files - Starting entry [Get Apache Files] 2012/01/02 05:30:26 - Get Apache Logs - Starting entry [Write To Log 1] 2012/01/02 05:30:26 - Get Apache Logs - Starting entry [Create Temp Destination] 2012/01/02 05:30:26 - Get Apache Logs - Starting entry [Clean Temp Folder] 2012/01/02 05:30:26 - Get Apache Logs - Starting entry [Get Apache Files] 2012/01/02 05:30:26 - Get Apache Files - Running on platform : Linux 2012/01/02 05:30:26 - Get Apache Files - Executing command : /usr/bin/php /opt/kaltura/dwh/etlsource//scripts//fetch_local_logs.php /opt/kaltura/log kaltura_apache_access.log-.* /opt/kaltura/tmp/dwh_inbound/bandwidth_usage 127.0.0.1 3306 etl etl 7 2012/01/02 05:30:26 - Get Apache Files (stdout) - Copying to /opt/kaltura/tmp/dwh_inbound/bandwidth_usage 2012/01/02 05:30:26 - Get Apache Files (stdout) - Getting file list... 2012/01/02 05:30:26 - Get Apache Files (stdout) - Getting registered files from mysql for process_id 7. 2012/01/02 05:30:26 - Get Apache Files (stdout) - Connecting to database...Copying kaltura_apache_access.log-20120102.gz 2012/01/02 05:30:26 - Get Apache Logs - Starting entry [ files] 2012/01/02 05:30:26 - List files - Loading transformation from XML file [file:////opt/kaltura/dwh/etlsource/common/list_files_from_dir.ktr] 2012/01/02 05:30:26 - list_files_from_dir - Dispatching started for transformation [_files_from_dir] 2012/01/02 05:30:26 - list_files_from_dir - This transformation can be replayed with replay date: 2012/01/02 05:30:26 2012/01/02 05:30:26 - Get File Names.0 - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0) 2012/01/02 05:30:26 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Get Apache Logs - Finished job entry [ files] (result=[true]) 2012/01/02 05:30:26 - Get Apache Logs - Finished job entry [Get Apache Files] (result=[true]) 2012/01/02 05:30:26 - Get Apache Logs - Finished job entry [Clean Temp Folder] (result=[true]) 2012/01/02 05:30:26 - Get Apache Logs - Finished job entry [Create Temp Destination] (result=[true]) 2012/01/02 05:30:26 - Get Apache Logs - Finished job entry [Write To Log 1] (result=[true]) 2012/01/02 05:30:26 - fetch_www_files - Starting entry [Move Files] 2012/01/02 05:30:26 - fetch_www_files - Finished job entry [Move Files] (result=[true]) 2012/01/02 05:30:26 - fetch_www_files - Finished job entry [Get Apache Files] (result=[true]) 2012/01/02 05:30:26 - fetch_www_files - Finished job entry [Set Temp Storage Location] (result=[true]) 2012/01/02 05:30:26 - Get files and generate cycle - Starting entry [Check for files] 2012/01/02 05:30:26 - Total files - We found : 1 file(s) 2012/01/02 05:30:26 - Get files and generate cycle - Starting entry [Generate cycle] 2012/01/02 05:30:26 - Generate cycle - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/generate_cycle.ktr] 2012/01/02 05:30:26 - Generate cycle - Dispatching started for transformation [Generate cycle] 2012/01/02 05:30:26 - Generate cycle - This transformation can be replayed with replay date: 2012/01/02 05:30:26 2012/01/02 05:30:26 - Table output.0 - Connected to database [kalturadw_ds] (commit=1000) 2012/01/02 05:30:26 - Get table.0 - Finished reading query, closing connection. 2012/01/02 05:30:26 - Get table.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0) 2012/01/02 05:30:26 - generated cycle.0 - 2012/01/02 05:30:26 - generated cycle.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:26 - generated cycle.0 - cycle_id = 1 2012/01/02 05:30:26 - generated cycle.0 - 2012/01/02 05:30:26 - generated cycle.0 - ==================== 2012/01/02 05:30:26 - Filter rows.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Get now.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Calculator.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Table output.0 - Finished processing (I=0, O=1, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Set Variables.0 - Setting environment variables... 2012/01/02 05:30:26 - Set Variables.0 - Set variable CycleID to value [1] 2012/01/02 05:30:26 - generated cycle.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - add partition.0 - Finished reading query, closing connection. 2012/01/02 05:30:26 - add partition.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Set Variables.0 - Finished after 1 rows. 2012/01/02 05:30:26 - Set Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Get files and generate cycle - Starting entry [Create originals cycle folder] 2012/01/02 05:30:26 - Get files and generate cycle - Starting entry [Unzip files attempt] 2012/01/02 05:30:26 - Unzip files attempt - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/unzip_files.ktr] 2012/01/02 05:30:26 - Unzip files - Dispatching started for transformation [Unzip files] 2012/01/02 05:30:26 - Unzip files - This transformation can be replayed with replay date: 2012/01/02 05:30:26 2012/01/02 05:30:26 - Execute a process.0 - Starting to run... 2012/01/02 05:30:26 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Write to log.0 - 2012/01/02 05:30:26 - Write to log.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:26 - Write to log.0 - gunzip /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/kaltura_apache_access.log-20120102.gz 2012/01/02 05:30:26 - Write to log.0 - 2012/01/02 05:30:26 - Write to log.0 - ==================== 2012/01/02 05:30:26 - Get events file names.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Filter rows.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Modified Java Script Value.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Write to log.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:26 - Execute a process.0 - Finished processing (I=0, O=0, R=1, W=1, U=1, E=0) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [Print Cycle ID to stream for generating] 2012/01/02 05:30:27 - Print Cycle ID to stream for generating - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/print_cycle_id_to_stream.ktr] 2012/01/02 05:30:27 - print_cycle_id_to_stream - Dispatching started for transformation [print_cycle_id_to_stream] 2012/01/02 05:30:27 - print_cycle_id_to_stream - This transformation can be replayed with replay date: 2012/01/02 05:30:27 2012/01/02 05:30:27 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [set cycle status generating] 2012/01/02 05:30:27 - set cycle status generating - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/set_cycle_status.ktr] 2012/01/02 05:30:27 - set_cycle_status - Dispatching started for transformation [set_cycle_status] 2012/01/02 05:30:27 - set_cycle_status - This transformation can be replayed with replay date: 2012/01/02 05:30:27 2012/01/02 05:30:27 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - set cycle status.0 - Finished reading query, closing connection. 2012/01/02 05:30:27 - set cycle status.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [split_files] 2012/01/02 05:30:27 - split_files - Loading transformation from XML file [/opt/kaltura/dwh/etlsource//cycles/split_files.ktr] 2012/01/02 05:30:27 - split_files - Dispatching started for transformation [split_files] 2012/01/02 05:30:27 - split_files - This transformation can be replayed with replay date: 2012/01/02 05:30:27 2012/01/02 05:30:27 - run 'split' files.0 - Starting to run... 2012/01/02 05:30:27 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Now splitting file.0 - 2012/01/02 05:30:27 - Now splitting file.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:27 - Now splitting file.0 - filename = /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/kaltura_apache_access.log-20120102 2012/01/02 05:30:27 - Now splitting file.0 - 2012/01/02 05:30:27 - Now splitting file.0 - ==================== 2012/01/02 05:30:27 - Log Delete.0 - 2012/01/02 05:30:27 - Log Delete.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:27 - Log Delete.0 - original_path = /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW 2012/01/02 05:30:27 - Log Delete.0 - dest_path = /opt/kaltura/dwh/cycles/originals/1/ 2012/01/02 05:30:27 - Log Delete.0 - wildcard = kaltura_apache_access.log-.* 2012/01/02 05:30:27 - Log Delete.0 - isArchived = false 2012/01/02 05:30:27 - Log Delete.0 - filename = /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/kaltura_apache_access.log-20120102 2012/01/02 05:30:27 - Log Delete.0 - short_filename = kaltura_apache_access.log-20120102 2012/01/02 05:30:27 - Log Delete.0 - path = /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW 2012/01/02 05:30:27 - Log Delete.0 - type = file 2012/01/02 05:30:27 - Log Delete.0 - exists = Y 2012/01/02 05:30:27 - Log Delete.0 - ishidden = N 2012/01/02 05:30:27 - Log Delete.0 - isreadable = Y 2012/01/02 05:30:27 - Log Delete.0 - iswriteable = Y 2012/01/02 05:30:27 - Log Delete.0 - lastmodifiedtime = 2012/01/02 05:30:26.000 2012/01/02 05:30:27 - Log Delete.0 - size = 484360 2012/01/02 05:30:27 - Log Delete.0 - extension = log-20120102 2012/01/02 05:30:27 - Log Delete.0 - uri = file:///opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/kaltura_apac... 2012/01/02 05:30:27 - Log Delete.0 - rooturi = file:/// 2012/01/02 05:30:27 - Log Delete.0 - shell_command = split -d -l 100000 /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/kaltura_apache_access.log-20120102 /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/split_kaltura_apache_access.log-20120102. 2012/01/02 05:30:27 - Log Delete.0 - result = 2012/01/02 05:30:27 - Log Delete.0 - newpath = /opt/kaltura/dwh/cycles/originals/1/kaltura_apache_access.log-20120102 2012/01/02 05:30:27 - Log Delete.0 - 2012/01/02 05:30:27 - Log Delete.0 - ==================== 2012/01/02 05:30:27 - Get events file names.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Now splitting file.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Modified Java Script Value.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - run 'split' files.0 - Finished processing (I=0, O=0, R=1, W=1, U=1, E=0) 2012/01/02 05:30:27 - Create new fields.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Is Archived default value.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Decide to Archive.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Log Delete.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - org.pentaho.di.trans.steps.processfiles.ProcessFiles - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Wait till all are split.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [Check if a generate folder is empty] 2012/01/02 05:30:27 - Total files - We found : 1 file(s) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [Register files] 2012/01/02 05:30:27 - Register files - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/register_files.ktr] 2012/01/02 05:30:27 - register_files - Dispatching started for transformation [register_files] 2012/01/02 05:30:27 - register_files - This transformation can be replayed with replay date: 2012/01/02 05:30:27 2012/01/02 05:30:27 - Table output.0 - Connected to database [kalturadw_ds] (commit=1000) 2012/01/02 05:30:27 - Get files.0 - Finished processing (I=0, O=0, R=0, W=1, U=0, E=0) 2012/01/02 05:30:27 - Formula.0 - Starting to run... 2012/01/02 05:30:27 - Registering file.0 - 2012/01/02 05:30:27 - Registering file.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:27 - Registering file.0 - filename = /opt/kaltura/dwh/cycles/generate/bandwidth_usage_WWW/split_kaltura_apache_access.log-20120102.00 2012/01/02 05:30:27 - Registering file.0 - 2012/01/02 05:30:27 - Registering file.0 - ==================== 2012/01/02 05:30:27 - Registering file.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Get now.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Formula.0 - Finished processing (I=0, O=0, R=1, W=1, U=1, E=0) 2012/01/02 05:30:27 - Table output.0 - Finished processing (I=0, O=1, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Filter rows.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - org.pentaho.di.trans.steps.processfiles.ProcessFiles - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - set cycle status fail.0 - Finished reading query, closing connection. 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [Check if a originals folder is empty] 2012/01/02 05:30:27 - Total files - We found : 0 file(s) 2012/01/02 05:30:27 - Get files and generate cycle - Starting entry [Print Cycle ID to stream for generated] 2012/01/02 05:30:27 - Print Cycle ID to stream for generated - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/print_cycle_id_to_stream.ktr] 2012/01/02 05:30:27 - print_cycle_id_to_stream - Dispatching started for transformation [print_cycle_id_to_stream] 2012/01/02 05:30:27 - print_cycle_id_to_stream - This transformation can be replayed with replay date: 2012/01/02 05:30:27 2012/01/02 05:30:27 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:27 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Get files and generate cycle - Starting entry [set cycle status generated] 2012/01/02 05:30:28 - set cycle status generated - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/set_cycle_status.ktr] 2012/01/02 05:30:28 - set_cycle_status - Dispatching started for transformation [set_cycle_status] 2012/01/02 05:30:28 - set_cycle_status - This transformation can be replayed with replay date: 2012/01/02 05:30:28 2012/01/02 05:30:28 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - set cycle status.0 - Finished reading query, closing connection. 2012/01/02 05:30:28 - set cycle status.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Get files and generate cycle - Starting entry [Success] 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Success] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [set cycle status generated] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Print Cycle ID to stream for generated] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Check if a originals folder is empty] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Register files] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Check if a generate folder is empty] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [split_files] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [set cycle status generating] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Print Cycle ID to stream for generating] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Unzip files attempt] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Create originals cycle folder] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Generate cycle] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Check for files] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [get files] (result=[true]) 2012/01/02 05:30:28 - Get files and generate cycle - Finished job entry [Validate process exists in DB] (result=[true]) 2012/01/02 05:30:28 - WWW bandwidth usage cycle process - Starting entry [process cycle] 2012/01/02 05:30:28 - Process cycle - Starting entry [Get generated cycles] 2012/01/02 05:30:28 - Get generated cycles - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/read_waiting_cycle.ktr] 2012/01/02 05:30:28 - Read waiting cycle - Dispatching started for transformation [Read waiting cycle] 2012/01/02 05:30:28 - Read waiting cycle - This transformation can be replayed with replay date: 2012/01/02 05:30:28 2012/01/02 05:30:28 - Get cycle id.0 - Finished reading query, closing connection. 2012/01/02 05:30:28 - Get cycle id.0 - Finished processing (I=1, O=0, R=0, W=1, U=0, E=0) 2012/01/02 05:30:28 - Write to log.0 - 2012/01/02 05:30:28 - Write to log.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:28 - Write to log.0 - cycle_id = 1 2012/01/02 05:30:28 - Write to log.0 - 2012/01/02 05:30:28 - Write to log.0 - ==================== 2012/01/02 05:30:28 - Write to log.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Process cycle - Starting entry [Process single cycle] 2012/01/02 05:30:28 - Process single cycle - Starting entry [set cycle status running] 2012/01/02 05:30:28 - set cycle status running - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/set_cycle_status.ktr] 2012/01/02 05:30:28 - set_cycle_status - Dispatching started for transformation [set_cycle_status] 2012/01/02 05:30:28 - set_cycle_status - This transformation can be replayed with replay date: 2012/01/02 05:30:28 2012/01/02 05:30:28 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - set cycle status.0 - Finished reading query, closing connection. 2012/01/02 05:30:28 - set cycle status.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Process single cycle - Starting entry [empty_cycle_partition] 2012/01/02 05:30:28 - empty_cycle_partition - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/empty_cycle_partition.ktr] 2012/01/02 05:30:28 - empty_ods_partition - Dispatching started for transformation [empty_ods_partition] 2012/01/02 05:30:28 - empty_ods_partition - This transformation can be replayed with replay date: 2012/01/02 05:30:28 2012/01/02 05:30:28 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - empty_cycle_partition.0 - Finished reading query, closing connection. 2012/01/02 05:30:28 - empty_cycle_partition.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Process single cycle - Starting entry [get waiting files] 2012/01/02 05:30:28 - get waiting files - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/read_waiting_files.ktr] 2012/01/02 05:30:28 - get waiting files - Dispatching started for transformation [get waiting files] 2012/01/02 05:30:28 - get waiting files - This transformation can be replayed with replay date: 2012/01/02 05:30:28 2012/01/02 05:30:28 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:28 - Select values.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Table input.0 - Finished reading query, closing connection. 2012/01/02 05:30:29 - Table input.0 - Finished processing (I=1, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Write to log.0 - 2012/01/02 05:30:29 - Write to log.0 - ------------> Linenr 1------------------------------ 2012/01/02 05:30:29 - Write to log.0 - cycle_id = 1 2012/01/02 05:30:29 - Write to log.0 - file_id = 2 2012/01/02 05:30:29 - Write to log.0 - file_name = split_kaltura_apache_access.log-20120102.00 2012/01/02 05:30:29 - Write to log.0 - 2012/01/02 05:30:29 - Write to log.0 - ==================== 2012/01/02 05:30:29 - Write to log.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Process single cycle - Starting entry [file_processing_job] 2012/01/02 05:30:29 - bandwidth_usage_process_cycle - Starting entry [Parse bandwidth files] 2012/01/02 05:30:29 - Parse bandwidth files - Loading transformation from XML file [/opt/kaltura/dwh/etlsource//bandwidth_usage//process/bandwidth_calculator.ktr] 2012/01/02 05:30:29 - Bandwidth calculator - Dispatching started for transformation [Bandwidth calculator] 2012/01/02 05:30:29 - Bandwidth calculator - This transformation can be replayed with replay date: 2012/01/02 05:30:29 2012/01/02 05:30:29 - Table output.0 - Connected to database [kalturadw_ds] (commit=1000) 2012/01/02 05:30:29 - Table output.1 - Connected to database [kalturadw_ds] (commit=1000) 2012/01/02 05:30:29 - Table output.2 - Connected to database [kalturadw_ds] (commit=1000) 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - Dispatching started for transformation [parsing www transformation] 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - This transformation can be replayed with replay date: 2012/01/02 05:30:29 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - Dispatching started for transformation [parsing www transformation] 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - This transformation can be replayed with replay date: 2012/01/02 05:30:29 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - Dispatching started for transformation [parsing www transformation] 2012/01/02 05:30:29 - [Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation - This transformation can be replayed with replay date: 2012/01/02 05:30:29 2012/01/02 05:30:29 - Get cycle and file.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Get cycle and file for enrichment.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - set file fullpath.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:29 - Text file input.0 - Opening file: /opt/kaltura/dwh/cycles/process/1/split_kaltura_apache_access.log-20120102.00 2012/01/02 05:30:30 - Text file input.0 - Finished processing (I=3330, O=0, R=1, W=3330, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].input.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].input.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].input.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Regex split row.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Filter rows.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Not a match.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - Mapping (sub-transformation).2 - Finished processing (I=0, O=0, R=1110, W=0, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Regex split row.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Filter rows.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Not a match.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:30 - Mapping (sub-transformation).1 - Finished processing (I=0, O=0, R=1110, W=0, U=0, E=0) 2012/01/02 05:30:30 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Regex split row.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:31 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Filter rows.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:31 - [[Bandwidth calculator].[Mapping (sub-transformation)].parsing www transformation].Not a match.0 - Finished processing (I=0, O=0, R=1110, W=1110, U=0, E=0) 2012/01/02 05:30:31 - Mapping (sub-transformation).0 - Finished processing (I=0, O=0, R=1110, W=0, U=0, E=0) 2012/01/02 05:30:31 - Enrich rows.0 - Finished processing (I=0, O=0, R=1, W=0, U=0, E=0) 2012/01/02 05:30:31 - Execute SQL script.0 - Finished reading query, closing connection. 2012/01/02 05:30:31 - Execute SQL script.1 - Finished reading query, closing connection. 2012/01/02 05:30:31 - Execute SQL script.2 - Finished reading query, closing connection. 2012/01/02 05:30:31 - bandwidth_usage_process_cycle - Finished job entry [Parse bandwidth files] (result=[true]) 2012/01/02 05:30:31 - Process single cycle - Starting entry [set cycle status processed] 2012/01/02 05:30:31 - set cycle status processed - Loading transformation from XML file [/opt/kaltura/dwh/etlsource/cycles/set_cycle_status.ktr] 2012/01/02 05:30:31 - set_cycle_status - Dispatching started for transformation [set_cycle_status] 2012/01/02 05:30:31 - set_cycle_status - This transformation can be replayed with replay date: 2012/01/02 05:30:31 2012/01/02 05:30:31 - Get rows from result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:31 - Get Variables.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:31 - set cycle status.0 - Finished reading query, closing connection. 2012/01/02 05:30:31 - set cycle status.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:31 - Copy rows to result.0 - Finished processing (I=0, O=0, R=1, W=1, U=0, E=0) 2012/01/02 05:30:31 - Process single cycle - Finished job entry [set cycle status processed] (result=[true]) 2012/01/02 05:30:31 - Process single cycle - Finished job entry [file_processing_job] (result=[true]) 2012/01/02 05:30:31 - Process single cycle - Finished job entry [get waiting files] (result=[true]) 2012/01/02 05:30:31 - Process single cycle - Finished job entry [empty_cycle_partition] (result=[true]) 2012/01/02 05:30:31 - Process single cycle - Finished job entry [set cycle status running] (result=[true]) 2012/01/02 05:30:31 - Process cycle - Finished job entry [Process single cycle] (result=[true]) 2012/01/02 05:30:31 - Process cycle - Finished job entry [Get generated cycles] (result=[true])
is my bandwidth usage cycle processing correctly? Please tell
Thanks[/]

[/]