MediaMill™

Product Overview

MediaMill™ is a Cognitive Mill product designed for fast and convenient media generation, without using third-party systems and software.

There are two ways how to use MediaMill™:

1. You can run it straight from the Cognitive Mill visualizer after the parent metadata process, such as Crop meta, Cast meta, Movie trailer, Soccer (or any other sport) meta, is completed.

2. You can also take your asset and a JSON file you have generated yourself and run a Media mill process.

When the process is completed, you can immediately download the output media to your device.

You need the Media mill quota to run the process. Click the name of your account on the top navigation bar to open My Account and check your quotas.

New users are provided with trial quotas. If you don’t have the required quotas, contact us at support@aihunters.com to get them.

Benefits:

  • You can get video metadata and immediately generate a clip without using any third-party systems or software.
  • Clip generation is a fully automated process unless you want to customize it.
  • To customize your clip, you can manually add or remove segments from the JSON file with video metadata.
  • You can automatically generate a reel of any type cropped to fit the popular social media aspect ratio 9:16 and ready for distribution. To generate a cropped trailer, include the cropping metadata into your trailer JSON file.
  • You can also contact us to customize your trailer configuration, such as the transition settings, and the logo. We can replace the default AIHunters logo with your company's logo. View the default configuration below.

Default Configuration

  
  {
      "logo": {
        "alpha": 0.5,
        "path": "./data/logo.png",
        "position": "right_down",
        "size": [
          160,
          100
        ]
      },
      "fade": {
        "color_rgb": [
          0,
          0,
          0
        ],
        "transition_frames_number": 5
      },
        "segment_rounding":
      {
          "start": "ceil",
          "end": "floor"
      }
    }    
  

Logo adds a watermark logo in one of the corners of the generated trailer. It includes the following parameters:

  • Alpha stands for alpha compositing of the frame and the logo. It sets the logo’s transparency. The valid range is [0, 1], where 0 is fully transparent, and 1 is fully opaque. The default value is 0.5, which is a semi-transparent logo.
  • Path is the link to the storage of the image.
  • Position specifies the corner where the logo is placed. The possible values are: right_down,right_up, left_down, left_up. The default value is right_down.
  • Size is the size of the logo in pixels. The default value is [160, 100].

Fade creates transitions between segments. It includes the following parameters:

  • Color_rgb stands for the color of transition. It is given in the uint8 range, from 0 to 255. By default, it’s black [0, 0, 0].
  • Transition_frames_number stands for the length of transition in frames. It shows how many frames from each side of transition must be processed. By default, the length of transition equals 5 frames. The last frame, which is the 5th, by default, is the clear color of transition.

Segment_rounding rounds start and end segment frame timestamps to the nearest frame.

  • "start": "ceil" configures the first (start) segment frame timestamp to be rounded to the next frame.
  • "end": "floor" configures the last (end) segment frame timestamp to be rounded to the previous frame.

Run Media Mill from the Visualizer

Running the Media mill process from the visualizer is a convenient way to create a reel via the UI.

First, you run a parent metadata process, and after it is completed, you go to the visualizer to preview the results, add more segments or delete the unwanted ones, and generate the media.

MediaMill™ is available for the processes where creating a reel makes sense, such as:

  • Movie trailer. Generate a movie trailer to immediately download it to your device.
  • Soccer/Hockey/Basketball/American football/etc. meta. Select a type of trailer you want to generate, run the process and download the result media.
  • Crop meta. Generate a cropped video to download and share it via social media.
  • Cast meta. Generate a reel with the selected character or characters.

MediaMill™ is not available for the processes aimed at detection where generating a reel doesn't make sense, such as Skip meta, Nude meta, and Graphics meta.

To generate a video clip, do the following:

1. Run the required parent process.

To get notified when the process is completed, select the Email notification checkbox. Anyway, you can always check the current status of your process on the Process List page.

2. When the status of the process changes to Completed, click the title of the process.

The process will be opened in the visualizer.

3. Add the required segments to Editor.

4. In Settings, click Run Media mill.

5. On the Media mill overlay that opens, enter a name for your process.

6. Click Generate

7. The process appears at the bottom of the page under the visualizer.
If it doesn’t appear, reload the page.

8. When the status of the Media mill process changes to Completed, click the three vertical dots icon.

9. In the pop-up menu that appears, click Get out media.

The generated trailer opens in a separate tab.

10. Click the three vertical dots icon in the bottom-right corner of your screen, then click Download.

The media gets downloaded to your device.

Note that the visualizer settings may look a bit different depending on the parent process. You can find the process-specific description of MediaMill™ usage in the Demo case of the selected product.

Run Media Mill as a New Process

You can run the process via the UI or via the API.

Before processing your video:

1. Sign in to your Cognitive Mill account or register if it's your first visit.

2. Click Run process on the top navigation bar.

On the Run a New Process page that opens:

3. Select Media mill from the Process type drop-down list.

4. In the Title field, enter a name for your process.

5. In the Video URL field, paste the link to the video you want to generate media for.

6. In the Trailer field, paste the JSON file.
The file must at least contain the following data:

  • ID. The trailer type that you enter in step 7.
  • Segment. A part of the media that forms the trailer. Each segment includes the Start and End timestamps given in milliseconds (ms).

  [  
  {
        "id": "diversity_trailer",
        "segments": [
            {
                "start": {
                    "ms": 0
                },
                "end": {
                    "ms": 50000
                }
            }
        ]
  }
]

For generating multiple trailers, the JSON file must contain segments for each Trailer id as shown in the example below:


  [    
  {
        "id": "high drama",
        "segments": [
            {
                "start": {
                    "ms": 0
                },
                "end": {
                    "ms": 50000
                }
            }
        ]
    },
    {
        "id": "attacks",
        "segments": [
            {
                "start": {
                    "ms": 50000
                },
                "end": {
                    "ms": 199980
                }
            }
        ]
    }
]

For generating a cropped trailer, add cropping metadata for each segment of the trailer JSON file. If any segment misses cropping data, the whole media generating process will fail.

An example of such a JSON file with one segment is given below:


  [  
  {
        "id": "diversity_trailer",
        "segments": [
            {
                "start": {
                    "ms": 0
                },
                "end": {
                    "ms": 55000
                },
                "crop": {
                    "crop_resolution": 0.5625,
                    "ms_data": {
                        "0.0": {
                            "crop_x": 0.34305555555555556
                        },
                        "50.0": {
                            "crop_x": 0.34305555555555556
                        },
                        "100.0": {
                            "crop_x": 0.34305555555555556
                        },
                        "150.0": {
                            "crop_x": 0.35
                        },
                        "200.0": {
                            "crop_x": 0.35
                        },
                        "250.0": {
                            "crop_x": 0.35694444444444445
                        },
                        "300.0": {
                            "crop_x": 0.35694444444444445
                      }
                }
            }
        ]
    }
] 

7. In the Trailer types field, enter the type(s) of your trailer(s), for example:

  • [“diversity_trailer”] for a movie trailer.
  • [“high drama”], ["operator based"], [“mid”], [“attacks”], or [“tense”] for sports.
  • [“out”] for a crop or cast meta.

8. Click Run Process.

The processing of the video has started. You can follow the progress on the Process List page, where your process appears in the current status.

To get notified when the process is completed, you can select the Email notification checkbox.

When the status changes to Completed, you can download the trailer to your device.

9. To download the file, click the three vertical dots icon.

10. In the pop-up menu that appears, click Get diversity_trailer media.
Note that it can be Get high drama media or other, depending on the trailer type you selected before running the process.

The generated trailer opens in a separate tab.

Click the three vertical dots icon in the bottom-right corner of your screen, then click Download.

The trailer is downloaded to your device.

Current Challenges

  • Content resolution and frame rates cannot vary.
    All video content must have the same resolution and frame rate. The frame rate must be constant and that will be the frame rate of the output media.
  • No data — no cropping.
    For cropping, each segment of the crop.json file must contain data for at least one timestamp (millisecond), otherwise the cropped video will not be generated.

We keep on searching for the most efficient ways how to overcome the current challenges so that in the following versions of MediaMill™ we won’t face them anymore.


We use cookies to ensure that we give you the best experience on our website. Read cookies policies.

Loading