CognitiveShapes™

Product and Solution Overview

CognitiveShapes™ is a Cognitive Mill product that offers you a top-notch Graphics Detection AI service that finds repetitive moving graphics, such as animated brand and TV logos, ad insertions in the TV and sports media events.

The AI-powered cloud robot identifies repetitive opening and closing animated graphics in any type of content, such as the news, TV shows, series, sports events, etc.

It detects game replays, ad insertions, other side content enclosed in animated graphics in both live and recorded videos and puts the corresponding time markers onto the video timeline for your convenient video post-processing.

CognitiveShapes™ offers a fast and reliable solution with high performance and a 100 percent guarantee against false detection.

We apply geometrical assessment and computer vision shapes and dynamics analysis where neural networks don’t work well enough. The graphics animation descriptor is color-agnostic and is based on the unique sequence of shapes.

The flow doesn’t need training and supervision procedures, which significantly reduces your time to market.

You provide us with an example of the animated graphics image you need to detect — our team creates a graphics animation descriptor or a graphics animation preset if you need to analyze multiple animated graphics. The preset is prepared in a couple of hours, and you can get it from us as a file, or we can store it in our system under your ID.

After that, you can run Graphics meta during live streams or process recorded video files, and the service will identify the exact moments where the animated graphics sequence appears.

And this is only a part of what our Graphics Detection solution can do.

After running the parent Graphics meta process, you get a result.json file that contains the names of the graphics animation descriptor, or masks, and their time markers. You can use this metadata for further integrations via the API and processing with third-party software.

You can also preview the processed video with time markers in the Cognitive Mill visualizer.

Benefits:

  • CognitiveShapes™ is a highly efficient service for live streams. Originally tailored for live streams, it works fast and accurately. But it’s also suitable for recorded video content.
  • By applying the geometrical assessment and computer vision, we have achieved 100 percent protection against false detection.
  • CognitiveShapes™ automatically processes any type of content. It can detect repetitive moving graphics in sports events, movies, series, TV shows, or news.
  • A fast and easy start.
  • After running the Graphics meta process, you get a JSON file with time markers of the required graphics animation.
  • The system supports the analysis of opening and closing graphics animation. Contact us to implement this feature.

Output Metadata for the Graphics Detection solution

A Graphics result.json file you get after running the Graphics meta process contains time markers for each moving graphics item according to your sample that appears in the video.

Below is an example of a Graphics result.json file.

{
  "time_markers": [
    {
      "mask_name": "Eurosport_1",
      "ms": 30800
    },
    {
      "mask_name": "LaLiga”,
      "ms": 59520
    },
    {
      "mask_name": "LaLiga",
      "ms": 88600
    },
    {
      "mask_name": "LaLiga",
      "ms": 93960
    },
    {
      "mask_name": "Eurosport_1",
      "ms": 221840
   }
  ]
}
  

The Graphics result.json file contains Time markers that display the following metadata:

  • Mask_name is the name of your animation in the graphics animation preset.
  • Ms stands for milliseconds and marks the precise moment when the required graphics image appears in the video timeline.

Demo Case - How to Get Graphics Meta JSON File via UI

At the moment, you can create a Graphics meta process only via the API. We are sorry for the inconvenience, the UI option will be available soon.

But you can watch the status of your process on the Process List page and view the result in the Cognitive Mill visualizer when the process is completed.

When the process has been created, it appears on the Process List page in its current status.

Wait until the status of the process changes to Completed. Then you can download the result.json file with all the time markers and view the result in the Cognitive Mill visualizer.

To download the result.json file:

1. Click the three vertical dots icon.

2. In the pop-up menu that appears, click Get result.json.

The Graphics result.json file has been downloaded to your device.

To view the result in the Cognitive Mill visualizer:

1. Click the title of the process.
The Cognitive Mill visualizer opens.

2. Navigate to the time markers in the video timeline to view how accurately they mark the moving graphics appearing in the video.

Here is an episode between the following time markers from the example result.json file:

"ms": 88600

"ms": 93960

Current Challenges

  • Changes in aspect ratio can make the descriptor invalid.
    Though the system is color-agnostic and insensitive to aspect ratio resize, significant changes in aspect ratio in the processed media, compared to the original, can make the graphics animation descriptor invalid, and it will need an update.
  • Frame rate changes may affect detection.
    Significant changes in frame rate may break the animation sequence, and this way can affect the detection.
  • Transparent overlays may not be detected.
    If the overlays are too transparent and the background breaks the initial shapes seriously, they may not be detected.
    But anyway, we guarantee that false detection is excluded.

We are working hard on the most efficient ways to overcome the current challenges so that in the following versions of CognitiveShapes™ we won’t face them anymore.


We use cookies to ensure that we give you the best experience on our website. Read cookies policies.

Loading