CognitiveReelz™ Movies

Product and solution overview

CognitiveReelz™ Movies is one of the Cognitive Mill products that offers you an outstanding solution for creating highlight reels for movies, TV series, TV shows, etc. It analyzes video patterns, summarizes the content, creates trailers, highlights, and more.

Our cognitive computing cloud solution processes a video, and selects the brightest and the most emotional scenes as a human would, and does it much faster. It takes a few clicks to start processing and the machine does the rest.

One of the core CognitiveReelz™ solutions is Automated Movie Trailers Generation. By running a movie trailer process, you can get metadata for creating a movie teaser composed of the most intense and meaningful scenes with the most notable dialogues. These automatically generated trailers do not aim to challenge Hollywood, but they offer a fast and easy cost-efficient way to create a quality teaser for any movie or series episode.

The system analyzes video content, selects highlights, and marks the corresponding segments. Thus you get a trailer.json file with time markers for compiling the final trailer with your software or use MediaMill™ to create the final video without leaving the Cognitive Mill platform.

Benefits:

• You get metadata for generating a movie teaser in JSON format.
• You can create a movie trailer using our automatic media generator MediaMill™ or download the trailer.json file and compile the final video with your software.
• The video is processed in the fully automated mode without human involvement, which is faster and cheaper.
• You can interact with the platform either via the UI or API.

Output metadata

After running a movie trailer process, you get a trailer.json file that is essential for Automated Movie Trailer Generation. It shows data with the timemarkers for required segments and metadata that contains the information about the modules and versions for internal use.

The data array of objects displays the following properties:

• ID. The type of a trailer preset. For movie trailers, the preset type is “diversity_trailer”.
• Type. The type of content. For the movie trailer process, the type of content is always “shot”.
• Start. The start time of a segment, which includes:
  - Time. The precise time when the segment starts.
  - Ms. The precise time when the segment starts in milliseconds.
• End. The end time of a segment, which includes:
  - Time. The precise time when the segment ends.
  - Ms. The precise time when the segment ends in milliseconds.
• Repr_ms. The time marker (in milliseconds) of the representative frame within the current shot. The frame that best describes the current shot.
• Type. Indicates the entity format type.

Additional parameters for internal use:

• Story. The sequential number of the story episode.

Type. Indicates the type of meta, for example, movie trailer.

Version. Displays the output format vesion of the JSON file.

Below is a snippet of the trailer.json file you get after running a movie trailer process.

  {
    "data": [
      {
        "id": "diversity_trailer",
        "segments": [
          {
            "end": {
              "ms": 820892,
              "time": "0:13:40.892000"
            },
            "repr_ms": 818000,
            "start": {
              "ms": 816680,
              "time": "0:13:36.680000"
            },
            "story": 4,
            "type": "shot"
          }
        ],
        "type": "time segments"
      }
    ],
    "metadata": {
      "description": {}
    },
    "type": "movie trailer",
    "version": "1.0.0.0"
  }

You can download this trailer.json file for further processing with your software or generate a movie trailer on our platform by using MediaMill™.

Demo case

This guide shows you how to automatically generate a movie trailer via the UI at run.cognitivemill.com.

Before creating your trailer, you need to sign in to your account or sign up to create a new account if it’s your first visit. And don't forget to make sure you have the required movie trailer quota to get your video processed.

To check quotas, click the name of your account in the top-right corner of the screen. You land on the My Account page with the list of your quotas.

New users are provided with trial quotas. If you don’t have the required quotas, contact us at support@aihunters.com to get them.

Download metadata

After that you are ready to run your process:

1. Click Run Process on the top navigation bar.

The Run a New Process page opens.

2. Select movie trailer from the Process type drop-down list.

3. In the Title field, enter a name for your process.

4. In the File source field, either paste a link to the video you want to process — the default File link option — or click the field > select Upload file > click Select file > pick the file from your device to upload.

5. (Optionally) In the Trailer config field, enter the length of the trailer you want in seconds. The length of the trailer is set to 60 seconds (one minute) by default. You can set a custom length if you want.

6. Click Run Process.

The processing of the video has started. You can follow the progress on the Process List page, where your process appears in the current status.

When the status changes to Completed, you can download the trailer.json file.

7. To download the file, click the three vertical dots icon next to your completed process.

8. In the pop-up menu that appears, click Download result.

The trailer.json file has been downloaded to your device.

Create movie trailer in fully automated mode

You can preview the trailer in the Cognitive Mill visualizer and generate a movie trailer in the fully automated mode.

When the status changes to Completed, click the title of the process to open it in the visualizer.

1. Click Add to Editor above the meta timeline. The segments are added to Editor.
Click Play to preview the trailer if you like.

2. Click Run MediaMill to start the media generation process.

The Media mill page opens.

3. Enter a name for your trailer generation process.

4. Click Run Process.

The creation of your media file has started. The process appears at the bottom of the page.

5. When the status of the process changes to Completed, click the three vertical dots icon, and then click Download result to open the generated trailer in a separate tab.

The trailer opens in a new tab.

6. To download the trailer, click the three vertical dots icon in the bottom-right corner, and then click Download.

The media file has been downloaded to your device.

Current challenges

• No speech — no trailer.
  The Movie Trailer process was originally designed for serials and popular movies that have plenty of engaging dialogs. The system, while processing a video, considers speech alongside the most impressive visual scenes and selects the best in both categories for the final set. So currently, this type of process is not suitable for silent movies.
• Shorter without action.
  You may get a trailer a couple of seconds shorter than you have set in the configuration if the video is relatively static and monotonous.

We keep on searching for the most efficient ways how to overcome the current challenges so that in the following versions of CognitiveReelz™ Movies we won’t face them anymore.