Guidance on the Corner Pin Studio

I have to track and insert into several computer monitors, and am hoping Corner Pin Studio will work here. I’m not clear on the concept of Foreground and Background implemented here. Is there more documentation, and any video demos besides the 2 minute intro? Thanks.

  • Harry

Hey Harry,

I have just finished a tutorial on this exact topic for the Boris FX YT channel, so Peter will be able to let you know when it’s going live. It’s for Media Composer, but the concepts work exactly the same across all the host applications.

KPM

Corner Pin Studio has a lot of built in workflow flexibility which can be quite useful, but it’s important to get the naming conventions right. Think of Foreground as the clip you’re going to insert - i.e the clip that will be deformed by the pin. Think of the Background as the layer you will track, e.g. the shot of the monitor/phone/tablet/billboard/etc - the one whose motion you will analyze so that the Foreground/Insert stays locked to it. (If you want to composite the Insert layer BEHIND a tracking layer that was keyed/masked, you do that via the Composite Behind option, but the clip you’re inserting is still considered the Foreground and the clip you’re tracking is still considered the Background.)

In most hosts you can apply Corner Pin Studio to either the Foreground clip (and then select the right Background track) or you can apply Corner Pin Studio to the Background clip (and then select the right Foreground/Insert layer). Once you apply the filter and choose the right foreground/background layer, the next step is to place the four Corner Pin point picker locations on the right positions for your current point in the timeline. Then launch Mocha and the default shape/surface will align with those initial starting points that you set. Go ahead and track as usual in Mocha, fine tune the surface corner locations as necessary, and apply back. You should see the Foreground/Insert following the tracked Background layer. The rest is then a matter of fine tuning the composite/scale/offset/color etc. using the rest of the controls.

Does that help you get started? More detailed tutorials will be added soon.

We’ll be posting Kevins new Corner Pin Studio in Avid tutorial shortly. It’s a great in depth look at how to use this filter to achieve exactly the result you’re looking for.

Cheers,
Peter.

Thank you, guys. Kevin, I’m very much looking forward to your tutorial. It couldn’t come at a better time. Attached is my current task, the first shot in a sequence full of these monitors. Monitors

The shots are seemingly all hand-held, with people walking through on a regular basis. Yikes!

  • Harry

There are very many Mocha tutorials on the Boris FX website and the knowledge is easily translated to Corner Pin studio. Depending on the motion of your shot, you may be able to track just one montior and apply (link) the tracking data for each montior. Or possibly one track for the first 6 could be used, one for 7-12, etc. Montiors on each row are most likely all on the same relative plane.

You will want to avoid the blue screens and focus Mocha to track only the edges of the screens.

Lastly, with 12 screen comps, this is most likely a candidate to finish in a compositing app like AE, Nuke or Flame with Mocha tracking. Not to discourage you, it can be done in Corner Pin Studio and Primate on an editing system like Avid or Premiere, but will not be very interactive or enjoyable.

Hope this helps.
-Ross

Thank you for the advice. I found putting the insert on the top layer and on that applying the effect to be counter-intuitive. The terms ‘foreground’ and ‘background’ are a bit misleading. ‘Insert’ would be more precise and consistent.

I ended up using mocha Pro in AMC. Starting with the background plate, added mocha Pro, tracked the shot, then created one of the screen inserts. Into that I imported the .mov file, rather than use the layer below as insert. I then copied that clip to a lower layer, and repeated the insert with a different monitor. With up to 13 layers of mocha, my system ground to a halt. So I did some video mixdowns to simplify the processing. Once the screens are created, I place a clean layer of the BG plate on top and key it with Primatte.

This worked until I upgraded to mocha Pro 2020. My imported .mov insert screens went black. Upon opening up in the effect editor / mocha interface, there was an error message about the media being corrupt (I reported this error in the mocha Pro forum). Downgrading to 2019.5 restored the video imports.

I am only doing these as temps to get the producer to sign off on the design of the screens. Ultimately, a professional will actually make these shots.

BTW, I’ve looked at every mocha Pro tutorial I can find on the Boris site, Youtube, Vimeo. Although extremely helpful, it takes time for me, an editor, to absorb the concepts (tracking, insert layer, surface tool, grid tool) and how they work together. At times I track a shot, create an insert, then get wildy off results. It baffles me when the surface moves differently from the insert shape.

The hardest part, I think, is understanding how to correctly track a shot. Most of the shots in the demos are relatively straightforward. The shots I encounter seem much more complicated. Shots that are handheld, with two people walk through the frame, at times completely blocking the frame and surface I’m tracking. Or a green card with no tracking marks that should be a photograph, but is variously blocked, curled and moved, making it seemingly impossible to track.

I love the challenge, though. And greatly appreciate the feedback and support from BorisFx.

  • Harry

I completed the temp screens on about 10 shots, with between 2 and 13 screens per shot. Mocha worked extremely well. But once you get 7 - 8 layers of mocha shots, the Avid gets very slow. But it worked.

My question is how would I make the screens more realistic? Doing a basic replace screen with a Quicktime file shows a very bright and sharp screen image. What should I add to blend the screen better?

Thanks.

  • Harry

Generally screens are much dimmer and less saturated than you would think. If the screen is black than you can typically do a comp set to “screen” and bring opacity down. Since your screens are already blue, your best best is to color correct and reduce the brightness and saturation. Then add a small blur to match the shot.

The final compositor might choose to key the blue out and put screens below which will give more options.

Sometimes very subtle fake reflections, lights or glows can help sell the shot as well.

Thank you. H

  • Harry

Hi Peter, I’ve managed to track two videos onto banners on the side of a shop wall by putting Corner Pin on the top track, the background video is in the middle, so working on the top layer i can go A-B down to the background, Then again on the middle layer i put Corner Pin to select the bottom layer & pin it up onto the middle layer, if that makes sense, but that’s as far as i can go,
Did the tutorial you mention get posted & does it allow multiple images to be pinned to one event/track like harrmilleriii shows in his pic? Thanks

Here’s a link to the most recent Corner PIn Studio tutorials in Avid :

https://borisfx.com/videos/?tags=host:Avid%20Media%20Composer,product:Continuum&search=corner%20pin%20studio

Each of these video tutorials demonstrate how to pin one image clip onto another image clip.

If it were me and I needed to pin multiple source clips onto another clip, I would probably elect to do this type of work in a compositor instead of an editing app. If I was just pinning a single image/clip then I’d be inclined to stay in the editing app but pinning several clips onto another clip is much easier and faster in a compositing app which was designed for this purpose.

Thanks for replying, I’ve watched all the Corner pinning vids on Boris site & YT, I can do 1 & if i need to on the rare occasion i can do 2 as in my pic, If i want more clips applied to clips i’ll render out the clip & do the process over n over,
My main focus is just trying to learn Match move or Corner Pin to see what they can do & if they’re right for my needs so that i can apply text to my videos, I make YT vids of my work, I’m a Joiner, quite often these consist of 20-40 clips cut & joined with a simple 9frame crossfade, along the way i like to add text to point out important things or things i forgot to mention, it’s nice if these followed the item in the vid, sometimes there’s a few (3-20 :man_shrugging:) of these text pointers,


Corner Pin has to be applied as a Custom composite to the whole track in Vegas, It seems i’d have to create a track for each text, does Mocha Pro have to be composited as a Custom to the whole track or can it be applied onto a single event? I find this tracking in Boris very good & interesting, i might buy Mocha Pro, (I need to watch more Mocha Pro vids :smirk:) Vegas Motion tracking is very poor & often won’t paste it’s tracking onto the text, & all other editing software i’ve had in the past hasn’t had tracking, keying frame by frame is a pain.
Just trying to track one text i get this msg a lot

Corner Pin gives me 4 circles for tracking, but wherever i put them i get that error message or my text is miles away because i had to put these circles in a place it would track, i tried with a spline, that’s where that error msg pick was from, good light day, the no’ plate is in full view all the time,
4circles
But when i applied a gaussian blur to mask my no’ plate (which i do in my vids) the built in Mocha within the blur fx works spot on, excellent :+1: Like i say i do really like Continuum & this tracking but just need to learn how to apply it & am willing to buy Mocha Pro if it means i can apply tracking to individual events/texts. shame Title Studio doesn’t seem to have built in Mocha,
Thanks a lot for your help, I’m sure it’s a pain trying to explain to numpties like me who stick nails in bits of wood for a living.

If you read all that above, thankyou & sorry if i wasted your time, I downloaded the trial version of Mocha Pro, I like that i can add it to my text a little like the inbuilt mocha versions in some of the fx’s in Continuum & i like that there’s a lot more control within the launched Mocha Pro window, I got several texts to track along individual clips within a timeline by parent childing the texts to the main vid sequence & just tracking the section i was putting text on in Mocha Pro, i can then shrink those tracks so they’re out of the way, I might have to render out the whole vid clips track first then put the text on after because after a few clips my PC starts getting a bit confused & grumpy, Thanks again :+1::+1:

Hi, gid.joiner,

One thing I notice from the screenshots is that it seems like you might be doing the tracking with the older BCC Corner Pin instead of the newer BCC Corner Pin Studio which has improved Mocha integration. If you have access to Continuum 2020 (V13.0.x) or higher you should have the option to use Corner Pin Studio which will make the tracking scenario you describe on the back of the van work more smoothly (tracking a single region instead of four separate corner regions). Here’s a tutorial specifically for Vegas about Corner Pin Studio.

Hope this is of some help, but for multiple separate pins it can still be awkward to work around some of the limitations in Vegas’s workflow, so you pre-rendering some partial tracks may still be necessary. Mocha Pro adds interesting flexibility since you can pull in Insert layers directly as separate clips which can help work around some of the limitations of accessing secondary layers in Vegas.

Cheers,
Jason