Loading

CognitiveShapes™

Product and Solution Overview

CognitiveShapes™ is a Cognitive Mill product that offers you a top-notch Graphics Detection AI service that finds repetitive moving graphics, such as animated brand and TV logos, ad insertions in the TV and sports media events.

The AI-powered cloud robot identifies repetitive opening and closing animated graphics in any type of content, such as the news, TV shows, series, sports events, etc.

It detects game replays, ad insertions, other side content enclosed in animated graphics in both live and recorded videos and puts the corresponding time markers onto the video timeline for your convenient video post-processing.

CognitiveShapes™ offers a fast and reliable solution with high performance and a 100 percent guarantee against false detection.

We apply geometrical assessment and computer vision shapes and dynamics analysis where neural networks don’t work well enough. The graphics animation descriptor is color-agnostic and is based on the unique sequence of shapes.

The flow doesn’t need training and supervision procedures, which significantly reduces your time to market.

You provide us with an example of the animated graphics image you need to detect — our team creates a graphics animation descriptor or a graphics animation preset if you need to analyze multiple animated graphics. The preset is prepared in a couple of hours, and you can get it from us as a file, or we can store it in our system under your ID.

After that, you can run Graphics meta during live streams or process recorded video files, and the service will identify the exact moments where the animated graphics sequence appears.

And this is only a part of what our Graphics Detection solution can do.

After running the parent Graphics meta process, you get a result.json file that contains the names of the graphics animation descriptor, or masks, and their time markers. You can use this metadata for further integrations via the API and processing with third-party software.

You can also preview the processed video with time markers in the Cognitive Mill visualizer.

Benefits:

  • CognitiveShapes™ is a highly efficient service for live streams. Originally tailored for live streams, it works fast and accurately. But it’s also suitable for recorded video content.
  • By applying the geometrical assessment and computer vision, we have achieved 100 percent protection against false detection.
  • CognitiveShapes™ automatically processes any type of content. It can detect repetitive moving graphics in sports events, movies, series, TV shows, or news.
  • A fast and easy start.
  • After running the Graphics meta process, you get a JSON file with time markers of the required graphics animation.
  • The system supports the analysis of opening and closing graphics animation. Contact us to implement this feature.

Output Metadata

A Graphics result.json file you get after running the Graphics meta process contains time markers for each moving graphics item according to your sample that appears in the video.

Below is an example of a Graphics result.json file.

{
  "time_markers": [
    {
      "mask_name": "Eurosport_1",
      "ms": 30800
    },
    {
      "mask_name": "LaLiga”,
      "ms": 59520
    },
    {
      "mask_name": "LaLiga",
      "ms": 88600
    },
    {
      "mask_name": "LaLiga",
      "ms": 93960
    },
    {
      "mask_name": "Eurosport_1",
      "ms": 221840
   }
  ]
}
  

The Graphics result.json file contains Time markers that display the following metadata:

  • Mask_name is the name of your animation in the graphics animation preset.
  • Ms stands for milliseconds and marks the precise moment when the required graphics image appears in the video timeline.

Demo Case

This guide shows you how to generate a Graphics meta JSON file for further integration and processing via the UI at run.cognitivemill.com.

Before processing your video:

1. Sign in to your account or register if it’s your first visit.

2. Make sure you have the mask ID and the Graphics meta quota to get your video processed.

Check your quota in My Account by clicking the name of your account on the top navigation bar.

New users are provided with trial quotas. If you don’t have the required quotas or you haven't received the mask ID, contact us at support@aihunters.com to get them.

Now you are all set.

1. Click Run Process on the top navigation bar.

The Run a New Process page opens.

2. Select Graphics meta from the drop-down list of the Process type field.
Note that you can select only those processes for which you have quotas.

3. In the Title field, enter a name for your process.

4. In the Video source field, either paste a link to the video you want to process — the default Use video link option — or click the field > select Use video file > click Select file > pick a file from your device to upload.

5. In the Mask Id field, paste the ID for the mask we've provided you with.

6. (Optionally) Clear the checkbox to cancel the creation of a transcoded proxy file. The checkbox is selected by default.
A transcoded proxy file is lightweight, so it is easier and faster for the visualizer to open it.

7. Click the Run Process button.
The processing of the video starts. You can follow the progress on the Process List page, where your process appears in the current status.

When the status of the process changes to Completed, download the result.json file with all the time markers and view the result in the Cognitive Mill visualizer.

To download the result.json file:

1. Click the three vertical dots icon.

2. In the pop-up menu that appears, click Get result.json.

The Graphics result.json file has been downloaded to your device.

To view the result in the Cognitive Mill visualizer:

1. Click the title of the process.
The Cognitive Mill visualizer opens.

2. Navigate to the time markers in the video timeline to view how accurately they mark the moving graphics appearing in the video.

Here is an episode between the following time markers from the example result.json file:

"ms": 88600

"ms": 93960

Current Challenges

  • Changes in aspect ratio can make the descriptor invalid.
    Though the system is color-agnostic and insensitive to aspect ratio resize, significant changes in aspect ratio in the processed media, compared to the original, can make the graphics animation descriptor invalid, and it will need an update.
  • Frame rate changes may affect detection.
    Significant changes in frame rate may break the animation sequence, and this way can affect the detection.
  • Transparent overlays may not be detected.
    If the overlays are too transparent and the background breaks the initial shapes seriously, they may not be detected.
    But anyway, we guarantee that false detection is excluded.

We are working hard on the most efficient ways to overcome the current challenges so that in the following versions of CognitiveShapes™ we won’t face them anymore.


We use cookies to ensure that we give you the best experience on our website. Read cookies policies.