Drop Folder Configuration

11 replies [Last post]
Joined: 10/20/2012
Points: 16

Hi,

Can someone please point me to a documentation/online resource that shows the detailed configuration of Drop Folder in Kaltura CE 5.

I want to enable DROP FOLDER feature but i dont know where to start and how to proceed.

There is a Drop Folder Profile menu but i dont know how to feed required fields within this and then where/how to use that profile later.

any help would be greatly appreciated,
brad.

Joined: 01/05/2009
Points: 1697
Joined: 12/18/2012
Points: 66

that link doesn't work:

Access denied
You are not authorized to access this page.

Joined: 12/18/2012
Points: 66

possibly this is a link to http://cdnknowledge.kaltura.com/sites/default/files/Kaltura_Drop_Folder_... which contains:

The Kaltura technical support and engineering teams set and enable the Kaltura Drop Folder
service for a specific publisher account. Please contact Kaltura’s sales or technical representative
for more information on setting the service for your account.

I've managed to set up a folder in my home dir and attempted two file "drops". Firstly a .JPG at 11:46 which didn't work, and then a .MOV at 12:13 which also failed. See below.

tail -f /opt/kaltura/log/*.log | grep "ERR:\|PHP\|Stack trace" --color
2013-01-10 11:46:02 [0.000858] [172.16.23.1] [1715399537] [PS2] [kCoreException->__construct] ERR: Code: [1] Message: [no ready filesync on current DC]
2013-01-10 11:46:02 [0.001196] [172.16.23.1] [1715399537] [PS2] [KExternalErrors::dieError] ERR: exiting on error 10 - missing thumbnail fileSync for entry
2013-01-10 12:13:39 [0.015704] [127.0.0.1] [1642735893] [API] [kCoreException->__construct] ERR: Code: [OBJECT_TYPE_NOT_ALLOWED] Message: [Object type [DropFolder] not allowed]
2013-01-10 12:13:39 [0.000320] [127.0.0.1] [1642735893] [API] [kAuditTrailManager->createAuditTrail] ERR: Error creating audit trail for object id[1] type[DropFolder] Object type [DropFolder] not allowed
2013-01-10 12:16:12 [0.000440] [172.16.23.1] [130229194] [PS2] [KExternalErrors::dieError] ERR: exiting on error 6 - requested flavor was not found

Both files were picked up in the KMC Content / Drop Folders page but failed to import: "Failed to create a new entry"

dropfolderhandler-0-2013-01-10.log

2013-01-10 11:36:25 [576951183] [BATCH] [KalturaClientBase->doQueue] DEBUG: result (object dump): Array
(
    [code] => FILE_DOESNT_EXIST
    [message] => File doesnt exist
)
...
2013-01-10 11:36:25 [576951183] [BATCH] [KalturaClientBase->doQueue] DEBUG: result (object dump): KalturaDropFolderFile Object
(
    [id] => 1
    [partnerId] => 104
    [dropFolderId] => 1
    [fileName] => P1010885.jpg
    [fileSize] => 241673
    [fileSizeLastSetAt] => 1357778061
    [status] => 9
    [parsedSlug] => P1010885
    [parsedFlavor] =>
    [errorCode] => 2
    [errorDescription] => Internal error adding new entry
    [lastModificationTime] => 1357778018
    [createdAt] => 1357778061
    [updatedAt] => 1357778185
)
Joined: 01/05/2009
Points: 1697

Sorry for the wrong link... here's the correct one: http://knowledge.kaltura.com/node/46
Note that the link you posted is the wrong one.. deprecated.
You should also try running on version 6, DF is better supported in that version.

Seems like a mis configuration from the log you pasted. What are the configurations you used?

Joined: 05/30/2013
Points: 2
Joined: 12/18/2012
Points: 66

I'm running v6 (pre 20/12/12) falcon

The Drop Folder profile is standard:

Ingestion Settings:
Conversion Profile ID: 2 - Default
Source File Name Patterns: *.*
Ignore file name... :
Ingestion Source: Content
Content Match Policy: Add as new

Local Storage Folder Location

Drop Folder Batch Datacenter Location: 0  (can't find any documentation on this field)
Drop Folder Storage Path: /home/{user}/drop (currently set to 777)

Is there anything else I need to set up?

It is picking up the file and the status changes to "Uploading" it but it changes to "Error / Failed to create a new entry"

Joined: 01/05/2009
Points: 1697
  1. What 'Type' is your Drop Folder? (Local / Remote FTP / Remote SFTP)
  2. What did you setup as the DF tags?
  3. Was 'Ingestion Workflow' configured to be 'Content' ?
  4. What is the 'Content Match Policy' set to be?
  5. The slug Regex, should be something like the following: /(?P<referenceId>.+)[.]\w{3,}/ for Remote FTP and /(?P<referenceId>.+)[.]\w{2,}/ for Local
  6. What is set for 'Ignore file name patterns' ?
  7. You mentioned the path is set to: /home/{user}/drop - do you really have {user} or is that something static in your setup (like /home/david/drop)?
  8. Does the Kaltura Server has access to the folder defined as the DF?
Joined: 01/17/2013
Points: 3

The link mentioned above gives a good overview of the drop folders, but seems to make the assumption that they're somehow already enabled and configured, with no information on how to actually enable/configure them on the server. Could you please point to a document that has the information on enabling drop folders in the first place?

Joined: 01/05/2009
Points: 1697

@danielg Were you able to resolve the issue through my above comments?

@ian_4 - Indeed there is room for a better documentation on that topic.

Joined: 12/18/2012
Points: 66

Hi Kalturian,

I didn't get it working but will be attempting another install soon on a non-local web server so hopefully I'll have better luck next time.

Also I was wondering if your development team is working with roadmap that you could share? Anything you could share about your sprint product/feature backlog would be great as I'm sure i'm not the only user who would like to get some visibility on the future of Kaltura.

Joined: 11/15/2010
Points: 30

anyone having success in using drop folders?
This used to work till CE5 ...
Right now, using type "Local", ignore file name patterns set to blank as folder has only videos, content match policy set to "Match existing or Add new entry" , slug regex modified correctly to reflect "...\w{2,} " ...
Folder has read write permissions, but it ends with an error "Failed to create an entry"