CognitiveReelz™ News
Product and solution overview
CognitiveReelz™ News is a Cognitive Mill product created specifically for news summarization.
Our Automated News Summarization solution analyzes the news content in the fully automated mode and selects the most noticeable scenes for highlight reels. And it also identifies the topic of the video from the list of topics you specify in the configuration, provides keywords and entities, and generates a text summary.
By running a news summary process, you get the JSON file with the following data:
1. Time segments for further highlights trailer generation.
2. Text summary with the entities mentioned in the video, and three versions of the video summary transcribed in the text along with the defined topic, and keywords.
You can use the trailer.json file with time markers for compiling the final trailer with your software or use MediaMill™ to generate and download the output video without leaving the Cognitive Mill platform.
Benefits:
- You get a summary of what was discussed in the video, the topic of the video, and the keywords defined.
- You get metadata in JSON format for generating a reel with the most noticeable moments.
- You can create a highlight reel using our automatic media generator called MediaMill™ or download the JSON file to compile the final video with your software.
- The whole process is fully automated, which is faster and cheaper.
- You can run a news summary process either via the UI or via the API
Output metadata
After running a news summary process, you get the JSON file that contains data with labeled segments for further processing and metadata that contains the information about modules and module versions for internal use.
The data part includes the following infrormation:
1. The text summary if you need the summarization what was discussed in the video with its topic, keywords, and entities.
2. The time markers if you need to generate a highlight reel.
The text summary part contains the following info:
- Entities. The list of proper names of people, countries, organizations, nationalities, etc. mentioned in the video.
- Summary. The compilation of the most meaningful sentences from what was said in the video. Usually, there are three versions of the summary, so that you can choose the most appropriate version.
- Topics. This element includes the topic itself, or there can be several topics with scores and corresponding keywords:
- Keywords. The keywords corresponding to the topic.
- Name. The topic of the video.
- Score. The accuracy of the topic recognition. As shown in the example below, the topic of the video is ‘Sports’ with an accuracy of 91%.
Below is snippet of the text summary part of the JSON file
{
"id": "text",
"info": {
"entities": [
{
"Olympics": "Named hurricanes, battles, wars, sports events, etc."
},
{
"Banon": "Companies, agencies, institutions, etc."
},
{
"Luke": "People, including fictional"
}
],
"summary_0": "Under a rainbow on top of a wave, Horisa More goes to work.
encouraging her along the journey, her dad, who doubles as her coach and
her husband, Luke, who owns Banon, a frozen dessert business, keeping
life sweet when competition gets stressful. He's a good, happy, positive
distraction.",
"topics": [
{
"keywords_": [
[
"sport",
"news",
"woman"
],
"name": "sports",
"score": 0.9145558476448059
}
]
},
"type": "entity"
},
The time segments part shows the following data:
ID. The identifier of a reel preset. You get two presets that vary in content and length.
Segments. The list of segments in the video timeline selected for a highlight reel. Each segment has the following properties:
- Start. The start time of a segment, which includes:
- Time. The precise time when the segment starts.
- Ms. The precise time when the segment starts in milliseconds. - End. The end time of a segment, which includes:
- Time. The precise time when the segment ends.
- Ms. The precise time when the segment ends in milliseconds. - Repr_ms. The time marker (in milliseconds) of the representative frame within the current shot. The frame that best describes the current shot.
Below is a snippet of the time segments part with time markers.
{
"id": "visual preview_1",
"segments": [
{
"end": {
"ms": 11259.711666666666,
"time": "0:00:11.259712"
},
"repr_ms": 13815.62,
"start": {
"ms": 8593.045,
"time": "0:00:08.593045"
}
},
{
"end": {
"ms": 18434.49166666667,
"time": "0:00:18.434492"
},
"repr_ms": 21858.04,
"start": {
"ms": 15767.825,
"time": "0:00:15.767825"
}
}
],
"type": "time segments"
},
You can download the JSON file for further processing with your software or generate a reel on the Cognitive Mill platform by running a media mill process.
Demo case
This guide shows you how you can automatically generate a news text summary and a news highlight reel via the UI at run.cognitivemill.com.
Before creating your reel, you need to sign up and create your account if it’s your first visit; or sign in to your account if you already have one.
Make sure you have the required quotas to get your video processed.
You need the news summary quota for running a news summary process.
To check quotas, click the name of your account in the top-right corner of the screen. You land on the My Account page with the list of your quotas.
New users are provided with trial quotas. If you don’t have the required quotas, contact us at support@aihunters.com to get them.
Run metadata process
When you are all set, go through the following steps:
1. Click the Run Process button on the top navigation bar.
The Run a New Process page opens.
2. Select news summary from the Process type drop-down list.
3. In the Title field, enter a name for your process.
4. In the File source field, either paste a link to the video you want to process — the default File link option — or click the field > select Upload file > click Select file > pick the file from your device to upload.
5. (Optionally) Customize the label list in the Config preview field. You can replace the default labels with your own ones.
6. Click Run Process.
The processing of the video has started. You can follow the progress on the Process List page, where your process appears in the current status.
When the status changes to Completed, you can download the JSON file.
7. Click the three vertical dots icon next to your completed process to download the file.
8. In the pop-up menu that appears, click Download result.
Create reel in fully automated mode
You can preview the reels in the Cognitive Mill visualizer and generate the output media in the fully automated mode.
To preview the reel:
1. When the process status changes to Completed, click the title of the process.
The process is opened in the visualizer where you can preview the reel before generating the output media.
The first trailer ID in the Timelines is selected by default so you can see the visualized metadata right under the video.
2. Click the Play icon to preview the reel.
You can select both trailers to preview.
If you want to unselect any of the trailers, click the corresponding checkbox to clear it — the visualized metadata disappears from the timeline under the video.
To generate the reel:
1. Click Add to Editor above the selected timeline.
The timeline is added to Editor.
2. Click Run MediaMill.
3. On the MediaMill page that opens, enter a title for your process.
4. Click Run Process.
The creation of your media file has started. The process appears at the bottom of the page in the current status.
5. When the status of the process changes to Completed, click the three vertical dots icon, and then click Download result to open and preview the reel in a separate tab.
The reel opens in a new tab.
6. Click the three vertical dots icon in the bottom-right corner, and then click Download.
The media file has been downloaded to your device.
Current challenges
- 10 minutes is the limit.
Currently, you can process only short videos up to 10 minutes long. If the video is longer, the process is likely to fail. This is a technical limitation that we are planning to overcome in one of the upcoming product updates. - News summary for news.
The product was designed specifically for news, that is why other content may be misinterpreted, and the topic, as well as keywords, might be identified incorrectly. For different types of content, try using CognitiveReelz™ Sports or CognitiveReelz™ Movies. - No speech — no summary.
It may seem obvious, but it won’t be redundant to emphasize that the video you provide for processing should be with human speech; otherwise there’s nothing to summarize.
We keep on improving the product so that in the following version of CognitiveReelz™ News we won’t face these challenges anymore.