Store and Manage Media Assets with eMAM and BlackPearl

Store and Manage Media Assets Simply, Permanently and Affordably with eMAM's Integration with Spectra Logic BlackPearl 

eMAM’s Support for DPX Sequences

eMAM’s Support for DPX Sequences

Digital Moving-Picture Exchange (DPX) file format is one of the industry standard data format for handling a single frame of a motion picture or video data stream. DPX file format supports the exchange of resolution-independent, pixel-based (bitmapped) images, intended for very high quality moving image content for post-production, theatrical distribution and for long term preservation; DPX masters provide the input for digital cinema digital projection systems. This format is used in Motion Pictures and Effects industry that make particular use of the extensive header information and format's flexibility to handle high dynamic range and logarithmic color values at a variety of bit depths using RGB or YCbCr pixel descriptions. It is based on, but largely supersedes, Kodak's Cineon format that has more film specific header.

DPX images may be produced by scanning film, using a camera that produces a DPX output or by a post-production application like Adobe Premiere Pro, After Effects and Speed Grade. Adobe supports the playback of entire DPX sequence as single footage and allows full control over parameters like bit depth, black point and log/linear space allows non-destructive changes to be made at any stage of production. Embedded metadata like timecode associated with each DPX frame allowing more control during the production process.

Challenges in Archiving DPX Sequence

DPX file format is suitable for almost any raster digital imaging application. It provides a great deal of flexibility in storing color information for exchange between production facilities.  Also, DPX Specification allows for a wide variety of metadata to further clarify information stored (and storable) within each file. However, the larger number of files is a major overhead for the database and archive system.

For example, an image file sequence requires one file per frame. Approximate 86,328 DPX files required to store 1 hour video in 23.98 fps. 674GB storage space is required to preserve that video in full HD (1920 x 1080). High speed SAN storage is required to ensure the reliable playback of the DPX sequence because each frame and associated metadata loading is over head for the storage.

Once the project is finished, it may not be required to keep the source DPX sequences in the expensive high speed storage.

Solution

Advanced archive solution eMAM Vault allows the users to move the DPX sequences from high speed storage to less expensive LTO storage for long term preservation and protection. eMAM has a built in algorithms to consolidate a DPX sequence to a single H.264 proxy video for web based playback, with each frame in the proxy video is linked to a DPX file. The algorithms help to consolidate the DPX files into a ZIP64 archive file before sending to deep LTO archive library. This reduces the overhead in the database and archive systems from processing large number of files and increased amount of metadata. eMAM can process multiple DPX sequences in a folder automatically, and also detect any broken DPX sequences and warn the user before sending the files to archive.

Empress is planning to extend the support for partial restore of the DPX sequence based on the set in/out points in eMAM rough cut window.

CAPEX vs OPEX

In times of tight budgets and tighter timetables, one of the interesting options organizations have for major projects is between capital spending (capex):  outright purchase and use over time and operational expenditure (opex):  making regular monthly payments.   The simplest analogy is choosing between purchasing a car (capex) and leasing it (opex).

Benefit of the Capex Model:

A purchase may give an organization valuable depreciation tax benefits.  Depending on the organization's cost of capital, it may also be cheaper for an organization to purchase it rather than lease it.

Benefit of the Opex Model:

Opex does not require an organization to make a major initial investment.   Many organizations have additional procedures for major purchases, which requires a great deal of labor and slows down the purchase of an important system.   Many people enjoy leasing a car, because they receive a brand new vehicle with the newest features when the lease is renewed:  this would be a huge benefit for the lease of a technology system.

Unlike a car lease with a fixed term, many opex programs are monthly or otherwise short term.   A short term lease allows organizations to rapidly change systems as their needs grow or change.   Purchased systems will not become obsolete in the face of changing technology.   The advent of cloud systems essentially removes the term, with rapidly scalable transmission and networking power provided as needed.

eMAM offers both Capex and Opex Models:

eMAM has offerings for organization for any purchasing paradigm:   systems installed on organizational hardware, leased on Empress hardware, or deployed on flexible cloud platforms.   We can provide systems for full media asset management, for LTO drives, for ingest stations, or for archive systems.   Companies can also avoid purchasing decisions altogether by using services from Empress and its partners for digitization, digital delivery, LTO delivery, or other services. 

Overview of Cloud Options

Overview of cloud-based options

There has been a massive shift in technology from the traditional server and storage system on-premise to a broader cloud-based server and storage solution. Many cloud-based technology companies are now offering affordable solutions in the cloud with an increase in available server options and cheaper storage options. With cloud based options expanding, companies are still struggling to grasp this new environment.

Whereas large volumes of documents (small file size) can be easily stored efficiently in the cloud, rich media, especially video, remains a challenge for many. Video file sizes can be staggering with raw and uncompressed 4k-movie trailers reaching 500GB’s or more.  The cost of storing huge amounts of data in the cloud can be prohibitive for some organizations.   Some cloud technology companies can charge as much as $1/GB monthly.   100TB x $1/GB = $100,000/month.

Connectivity and accessibility can also be a concern.   Simply put, if Internet connections are disrupted, the data is not available.   Regarding communication bandwidth, using a 1544Kbps connection to send a 1 Gb file will take at least 90 minutes in an ideal situation.  Organizations can solve this external issue with expensive dedicated connections or systems.   Non-linear video editing systems and other applications need high-speed connectivity to these data sources in order to function. With faster connectivity to the cloud, companies would limit the need for expensive proprietary storage systems for file sharing requirements.

Security remains an overriding concern for many organizations. With the increase in theft of consumer data, organizations must find ways to provide secure access to their most valued resource.   Many organizations do not allow data outside the organization’s physical boundaries of a secure network.   Some content may however be valued at different levels. For example, a media or broadcast company may have relaxed rules on shows that have already aired. Content providers like iTunes, Hulu or NetFlix typically control the access to these shows. All other content with higher value are forensically watermarked and must be viewed in a more controlled environment. 

Given the limitations and concerns above, what are the available cloud options and how do they address these issues?

Cloud options

Content in cloud    

This makes for a very simple solution for customers with no IT staff and internal infrastructure. Cloud-based solutions provide rapid and unlimited scalability for processing, storage and universal accessibility.   It requires no large upfront cost (capex).   As requirements change, a cloud-based model provides flexibility and expandability in a short period of time.

Storage costs can be overwhelming.   Often organizations are reluctant to remove items from storage; therefore increasing the amount needed to maintain day-to-day operations.  When much of the content is of marginal value, a pure cloud-based system may not be the best option.  For example, reality TV shows often shoot several hundred hours of multi-camera footage for a one hour show, leaving much of the content with little or no, while value taking up costly storage space.

A major concern with a cloud-based system is connectivity to the content.   If connectivity is lost, content cannot be uploaded or downloaded.   Whether fault lies with the customer or the cloud-based storage provider, the result is the same.   Regarding upload and download bandwidth, cloud vendors offer different levels of transmission rates in and out of their facility, but often find that organizations are limited by a much smaller pipe in and out of the origination site. 

Organizations rely solely on the cloud vendor to provide a secure environment, which may preclude them from considering such a system. Data in the cloud is rarely lost, because cloud vendors have implemented excellent protection services. Unauthorized access of high valued content has become more of an issue than data loss.

eMAM has a variety of cloud-based options from cloud partners Amazon, Windows, and ComputeNext. Depending on customer requirements, these vendors offer many affordable options.

Proxies in cloud

Sharing lower resolution proxy files in the cloud provides power, flexibility and adaptability to this new environment without the limitations of managing costly storage and time spent uploading full resolution content. Proxy files maintain a link back to the original file, either online or archived on LTO 5/6 tape. These original files in their native format can be located in one or more locations and maintained by the cloud-based database. 

With a cloud proxy system, organizations are required to maintain a file-based transcoder for proxy creation and storage for original content onsite (Capex). Proxies are created on-site and sent to the cloud storage for search, preview, and collaboration. Security issues still remain. Permissions describe what can and cannot be seen by users inside and outside the organization. Proxy quality is also an issue for some. Many organizations require higher resolution viewable video in a web-based player. Higher quality proxy files can be created and sent to the cloud, but unfortunately this will require more cloud storage.

A cloud proxy system does nothing to alleviate the onsite client requirements for hardware, storage, and infrastructure and the staff to support them.   In fact, it adds and additional burden of transcoding or rendering to make the proxy copies.   Because most of the processing and storage occurs onsite, upfront spending for system installation and the lack of flexible scalability are an issue.

This option creates only an isolated system, so delivery or download of a selected clip or project will still be a manual process, requiring important time and labor.  Unless all important content is carefully put into the system, the online library is inherently limited.   The wealth of an entire centralized accessible library is not available for sharing, promotion, or reuse.

Some cloud systems are only focused on this option.   eMAM can provide a system for this use at very attractive pricing.

Hybrid system 

A hybrid system keeps much or all of the native content in one or more local systems, even in different geographical locations to support local high speed connectivity as needed.   Storage can be in the most appropriate location, whether spinning discs for access, active archive with lower costs and better security, or offline/on the shelf for free.   The linked system automatically produces a linked copy, often a proxy copy, for cloud sharing and access.  Authorized users or clients with permission can access the entire library for online collaboration, download, and delivery.

Storage can be either onsite or in the cloud, or a combination, as needed for an organization globally, for a particular department, or for a given project.   An organization can balance the costs of cloud storage with those onsite.

Accessibility has the same issues as before.   A remote location with poor connectivity can prepare proxy copies and store in a localized environment.     Because the system would link all storage locations, content would be accessed in the most efficient manner.   

The power of such a system would be to truly link together storage in multiple different locations together in integrated system with access to a complete library of content.   A great deal of labor is wasted in searching for needed content and fulfilling media requests through non-integrated systems. 

eMAM has many options to provide such a hybrid system.   Some sites, such as on-location shoots, could produce proxy copies on a laptop or small system with native content copied to hard drive or LTO and shipped to offsite editors.   Offsite producers, clients, and others could begin collaborating remotely through a web interface.   Other locations can have multiple systems for storage and archive.   eMAM could tie all of these locations together through a cloud hybrid system with categories, projects, and permissions to manage content as needed. 

Empress unveils a flexible new eMAM™ interface and advanced integration with Adobe Premiere Pro CC at the Broadcast India Show

Mumbai, India-October 8, 2013--Empress Media Asset Management, LLC ( Empress) will showcase advances in its flagship eMAM media asset management system with the release of Version 3.4 at the Broadcast India Show, October 9^th-11^th, booth D410. eMAM is a full-featured media asset management software system designed to support all digital file formats for the demanding workflows of media, entertainment, and corporate customers. It is accessible using any standard web browser, easy to use, and scalable to support the needs of the largest organizations.

Version 3.4 is built on a widget style interface: users can add, remove, and resize elements to customize their own workspaces. These workspace templates can be stored for later use. Different departments can set standard workspaces for their staff. Users can share online logins to the eMAM library with end user clients with a customized (branded) interface, simplified functionality, and access to select asset categories or projects. To support flexibility and unify workflows, a new HTML 5 player has been developed with an entire range of functionalities. The new interface also has a new timeline editing feature for web-based rough cut editing or storyboarding. 

The integration with Adobe^® Premiere^® Pro CC has been extended with eMAM project export functionality and project version management features. These functionalities extend on the current built-in extension panel that allow editors to move projects in and out of the Adobe Premiere Pro CC desktop and export editing sequences. 

 “With Adobe Premiere Pro CC, our customers can edit video faster than ever. We continue to innovate with new features including improved media management, a redesigned timeline and more,” said Simon Williams, director of strategic relations at Adobe. “Empress is tapping into Adobe Premiere Pro CC to build powerful post production MAM workflows – definitely a priority for our users.”

David Miller, COO of Empress Media Asset Management, LLC commented, “We are looking for a tremendous response for eMAM at the show in Mumbai this week with the new features supported by our Indian development and service teams.”

About Empress (www.empressmam.com)

Empress Media Asset Management, LLC., a private company, is a  leading provider of digital asset management and workflow management systems for media & entertainment, and corporate clients.  It is part of the Empress family of companies, which includes Empress Cybernetics System PVT LTD, specializing in customized software and database development and Empress Media Inc., one of the largest distributors of blank recording media and supplies. To learn more visit www.empressmam.com

Empress Contact: Binu Paul CMD, Empress Cybernetic Systems Pvt Ltd. 1st Floor, Leela Phase II Info Park, Kakkanad, Kochi – 682030. Telephone: +91-484-4042440 binu@empressmam.com