CognitiveReelz™ News

Product and Solution Overview

CognitiveReelz™ News is a Cognitive Mill product created specifically for news summarization.

Our Automated News Summarization solution analyzes the news content in the fully automated mode and selects the most noticeable scenes for highlight reels. And it also identifies the topic of the video from the list of topics you specify in the configuration, provides keywords and entities, and generates a text summary.

By running a News summary process, you get two JSON files with the following data:

1. trailer.json with segments for further highlights generation.

2. text_summary.json with the entities mentioned in the video, and three versions of text summary of what was discussed in the video, the defined topic, and keywords.

You can use the trailer.json file with time markers for compiling the final trailer with your software or use MediaMill™ to generate and download the output video without leaving the Cognitive Mill platform.

Benefits:

  • You get a summary of what was discussed in the video, the topic of the video, and the keywords defined.
  • You get metadata in JSON format for generating a reel with the most interesting moments.
  • You can create a highlight reel using our automatic media generator called MediaMill™ or download the trailer.json file to compile the final video with your software.
  • The whole process is fully automated, which is faster and cheaper.
  • You can run a News summary process either via the UI or via the API

Output Metadata

After running a News summary process, you get two JSON files:

1. trailer.json if you need to generate a highlight reel.

2. text_summary.json if you need a text summary of what was discussed in the video with its topic, keywords, and entities.

Trailer JSON

The trailer.json file displays the following elements:

ID. The identifier of a reel preset. You get two presets that vary in content and length.

Segments. The list of segments in the video timeline selected for a highlight reel. Each segment has the following properties:

  • Start. The start time of a segment, which includes:
    - Time. The precise time when the segment starts.
    - Ms. The precise time when the segment starts in milliseconds.
  • End. The end time of a segment, which includes:
    - Time. The precise time when the segment ends.
    - Ms. The precise time when the segment ends in milliseconds.
  • Repr_ms. The time marker (in milliseconds) of the representative frame within the current shot. The frame that best describes the current shot.

Below is a snippet of the trailer.json file you get after running a News summary process.


  {
    "id": "1",
    "segments": [
      {
        "end": {
          "ms": 89806.38500000001,
          "time": "0:01:29.806385"
        },
        "repr_ms": 85885.8,
        "start": {
          "ms": 85806.38500000001,
          "time": "0:01:25.806385"
        }
      }

You can download the trailer.json file for further processing with your software or generate a reel on the Cognitive Mill platform by running a MediaMill™ process.

Text Summary JSON

The text_summary.json file shows the following data:

  • Entities. The list of proper names of people, countries, organizations, nationalities, etc. mentioned in the video.
  • Summary. The compilation of the most meaningful sentences from what was said in the video. Usually, there are three versions of the summary in each text_summary.json file, so you can choose the one you like most.
  • Topics. This element includes the topic itself, or there can be several topics with scores and corresponding keywords:
    - Keywords. The keywords corresponding to the topic.
    - Name. The topic of the video.
    - Score. The accuracy of the topic recognition. As shown in the example below, the topic of the video is ‘Sports’ with an accuracy of 91%.

Below is an example of a text_summary.json file (abridged).


  {
    "entities": [
      {
        "Olympics": "Named hurricanes, battles, wars, sports events, etc."
      },
      {
        "Banon": "Companies, agencies, institutions, etc."
      },
      {
        "Luke": "People, including fictional"
      }
      ],
    "summary_0": "Under a rainbow on top of a wave, Horisa More goes to work. encouraging her along the journey, 
    her dad, who doubles as her coach and her husband, Luke, who owns Banon, a frozen dessert business, 
    keeping life sweet when competition gets stressful. He's a good, happy, positive distraction.",
    
    "topics": [
      {
        "keywords_": [
          [
            "sport",
            "news",
            "woman"   
        ],
        "name": "sports",
        "score": 0.9145558476448059
      }
    ]
  }
  

Demo Case

This guide shows you how you can automatically generate a news text summary and a news highlight reel via the UI at run.cognitivemill.com.

Before creating your reel, you need to sign in to the demo account and create your account if it’s your first visit; or sign in to your account if you already have one. After that, you should make sure you have the required quotas to get your video processed.

You need the News summary quota for running a News summary process.

New users are provided with trial quotas. If you don’t have the required quotas, contact us at support@aihunters.com to get them.

Run Metadata Process

When you are all set, go through the following steps to get both JSON files:

1. Click the Run Process button on the top navigation bar.

The Run a New Process page opens.

2. Select News summary from the Process type drop-down list.

3. In the Title field, enter a name for your News summary process.

4. In the Video URL field, paste the link to the video you want to get a reel for.

5. (Optionally) If you don’t want to process the whole video but only a part of it, specify the starting and ending points of the segment in the video you want to process in the Start time and End time fields. The timestamps must be given in milliseconds.

6. In the Audio config field, paste the following default external configuration:


  {
    "mode": "full",
    "light_mode": {
       "min_silence_len": 300,
       "keep_silence": 0
    },
    "full_mode": {
       "diarization": false,
       "speech_to_text": true
    }
 }

7. In the External config field, paste the following default configuration:


  {
    "text": {
      "classification": {
        "labels": [
          "artifacts",
          "animals",
          "food",
          "sports",
          "tech",
          "politics",
          "business",
          "entertainment",
          "love",
          "history",
          "war",
          "music",
          "religion",
          "people",
          "children",
          "traveling",
          "medicine",
          "climate",
          "crime",
          "death"
        ]
      },
      "summarization": {
        "ratio": null,
        "min_length": null,
        "max_length": null,
        "num_sentences": 5
      }
    },
    "visual": {
      "include_non_informative_content": false,
      "minimal_threshold": 5
    }
  }
  

Note that you can replace the default labels with your own ones.

8. (Optionally) Clear the checkbox to cancel the creation of a transcoded proxy file to view the original video in the visualizer. The checkbox is selected by default. A transcoded proxy file is lightweight, so it is easier and faster for the visualizer to open it.

9. Click Run Process.

The processing of the video has started. You can follow the progress on the Process List page, where your process appears in the current status.

When the status changes to Completed, you can download the trailer.json and the text_summary files.

10. Click the three vertical dots icon next to your completed process to download the files.

11. In the pop-up menu that appears, click Get trailer.json, Get text_summary.json, or both, in turn, to download them to your device.

Create Movie Trailer in Fully Automated Mode

You can preview the reels in the Cognitive Mill visualizer and generate the output media in the fully automated mode.

1. When the process status changes to Completed, click the title of the process.
The process is opened in the visualizer.

The first trailer ID in the Timelines is selected by default so that you can see the visualized metadata under the video.

2. Click Add to Editor above the selected timeline.
If you want to preview the reel, follow the steps successively.
If you want to create a reel without preview, go straight to step 5.

3. Select the Play editor timeline checkbox.

4. Click Play.

5. To create a reel, click Run Media Mill.

6. On the Media mill page that opens, enter a title for your highlight reel generation process.

7. (Optionally) Select the checkbox for creating a lightweight transcoded proxy file.

8. Click Generate.

The creation of your media file has started. It appears at the bottom of the page.

9. When the status of the process changes to Completed, click the three vertical dots icon, and then click Get out media to open and preview the reel in a separate tab.

The reel opens in a new tab.

10. To download the reel, click the three vertical dots icon in the bottom-right corner, and then click Download.

The media file has been downloaded to your device.

Current Challenges

  • 10 minutes is the limit.
    Currently, you can process only short videos up to 10 minutes long. If the video is longer, the process is likely to fail. This is a technical limitation that we are planning to overcome in one of the upcoming product updates.
  • News summary for news.
    The product was designed specifically for news, that is why other content may be misinterpreted, and the topic, as well as keywords, might be identified incorrectly. For different types of content, try using CognitiveReelz™ Sports or CognitiveReelz™ Movies.
  • No speech — no summary.
    It may seem obvious, but it won’t be redundant to emphasize that the video you provide for processing should be with human speech; otherwise there’s nothing to summarize.

We keep on improving the product so that in the following version of CognitiveReelz™ News we won’t face these challenges anymore.


We use cookies to ensure that we give you the best experience on our website. Read cookies policies.

Loading