Jump to content

"HDR" motion video using 2 cams & a beamsplitter mirror?


Peter J DeCrescenzo

Recommended Posts

  • Premium Member

File this one under weird ideas:

 

EDIT: Duh, well I've now done a Google search on "HDR video" after I typed all this, so it looks like I've got some reading to do ... :-)

 

I'm curious if anyone here has experience with or has heard about shooting "HDR" motion video (not "traditional" HDR digital stills) using two identical video cams mounted at 90-degrees to each other and shooting through a partially-reflective beamsplitter mirror?

 

Similar to a teleprompter with its half-silvered mirror mounted in front of a single camera, but with a 2nd camera replacing the teleprompter CRT/LCD screen?

 

Both cams would frame the scene identically & use the same focal length lens, but one cam would be exposed for the shadows up through to the lower mid-tones, and the other cam would be exposed for the mid-tones up through the highlights.

 

The resulting video would be composited in post to (maybe?) yield video with a wider dynamic range than the cams would otherwise be capable of individually. For that matter, the resulting dynamic range may well exceed what's possible with an individual high-end camera costing much more than using 2 inexpensive cams instead.

 

This part makes my head hurt: Would you need to use a luminance-key to properly composite them together?

 

The following company sells beamsplitter mirrors, including 3" & 4" samples which might be large enough to at least experiment with (starting at only $6 US!):

http://www.stereoscopicmirrors.com/3d.htm

 

Anyone have 2 identical video cams & lenses they want to experiment with? Alternatively, a proof of concept could probably be done using 2 _still_ cams?

 

Anyway, I'd appreciate hearing comments & opinions about this, and whether or not something similar has already been done, or if there is a related camera/product/add-on being sold, or maybe this idea should be filed under "more trouble than it's worth"?*

 

- Peter

 

* Among other things, I can see how follow-focus might be an interesting, but not insurmountable, challenge.

 

EDIT: Change thread title & text from "stereoscopic" to "beamsplitter".

Link to comment
Share on other sites

The number of people playing around with this at home would probably number in the 1000's by now

 

Not many people talk about it online as they think they're the only ones and don't want to give the idea away - occasionally they pop up here and make a claim, only to receive a barrage of links to other people with a bunch of footage on youtube claiming a gazillion stops of latitude.

 

I don't mean to say its not worthy, or interesting - etc... just be ready to have your thunder stolen by individuals and groups with a lot more time, money and/or education under their belts ...

 

Have fun ! ;)

Link to comment
Share on other sites

  • Premium Member

You derive the alpha channel for the highlight pass using its inverted luminance.

 

That is: in Photoshop you put "dim" layer over "bright" layer. You select all and copy "dim". You enter quick mask and paste, then invert. You exit quick mask and hit "delete". If you have fringing problems you can blur the mask a few pixels, at the cost of glows on sharp luminance edges.

 

If it's anythig like doing HDR with DSLRs, you will then want to put a pronounced S-curve on it, which the literati would call a "viewing LUT", then a nonlinear desaturation of anything particularly saturated.

 

 

P

 

Edit: I think the excessive saturation issue may be caused by the way Photoshop does a colour-to-monochrome conversion in the circumstance where you're pasting RGB data into an alpha channel. You might experiment with other approaches, perhaps one based on the 709 Y channel derivation. Computer software tends to use either sum(RGB)/3 or max(RGB); the latter will cause oddities. Or better yet, do it per channel, though that might cause auto-knee-style strangeness where the "dim" channel clips a channel, depending on the relative linearity of your CCDs. Argh, this is complicated.

Link to comment
Share on other sites

  • Premium Member

Hi Chris: I'm not the least bit worried if others have tried or are trying to do something like this. Quite the opposite: I'd like to know if this idea might work, or if it's already "working".

 

I'm not interested in being an inventor or "productizing" this idea -- I'm just interested in learning if ...

 

2 identical video cameras mounted at 90 degrees, using identical lenses set at different f-stops*, concurrently shoot a live action scene through a partially-silvered mirror. Then composite the 2 recordings into a single video displaying higher dynamic range than either camera is capable of alone.

 

... might "work"?

 

I understood a small fraction of what Phil posted. Maybe. Gives me something to work with. Thanks Phil! :-)

 

* Oops: Using 2 f-stops would result in each source video having a DOF different compared to the other. Cool! (Not.) So, to avoid that you'd instead set the f-stops identically and adjust exposure on 1 cam using ND filters.

 

Most of the "HDR videos" examples I've found so far via Google & YouTube are digital still timelapses, or involve shooting a fairly static scene twice with one video cam. That's cool, but not what I'm interested in.

 

Fun!

Link to comment
Share on other sites

Yes it will work.

 

Better is to use one lens and have a beam splitter behind that going to multiple sensors ... But that is harder to do with limited resources, so in lieu of a R&D dept. try this out:

 

Build your rig... take a stills camera - shoot a static scene with your camera in position 1, move it without bumping registration to position 2, shoot the scene again ... Take the two stills and stick them in your favorite HDR plugin/prog and well ... you know the rest :P

 

As an aside - what do you mean by 'stereoscopic' mirror ? I take that as a front surface mirror with a kink in the middle or ?

Link to comment
Share on other sites

  • Premium Member
As an aside - what do you mean by 'stereoscopic' mirror ? I take that as a front surface mirror with a kink in the middle or ?

Hi Chris: I suppose I should just refer to it as a "beamsplitter". I've edited the title thread & text accordingly.

 

"Stereoscopic" is the term used by the company of the same name (linked to in my 1st post above). Apparently they make & sell a variety of mirrors.

 

Your suggestions are appreciated.

Link to comment
Share on other sites

My approach to this was to use one of the JVC high-def cams that does 50p, put an LCD shutter in front synced to dim every other frame, and sort out the result with motion compensated interpolation in post.

 

P

 

 

As a general rule how does one get the required sync from any given video camera and by whatever means necessary get a nice old fashioned square wave from it ?

 

...say an EX1 - which I'd have a couple of applications where I'd use that ;)

 

or did you just have it dimming at 25Hz and get it into phase manually ?

Link to comment
Share on other sites

  • Premium Member

Oh good grief I never actually did this - whaddayathink I am, a nutcase?

 

Usually you'd take a composite output and use a sync separator IC to derive a square wave from it. You'd need to modulate that square wave with an AC waveform to drive an LCD shutter panel. It's not rocket science.

 

post-29-1257636912.jpg

 

That's one scanline of composite video (showing colourbars). The big negative-going bit right at the start is the sync pulse.

 

P

Link to comment
Share on other sites

The big negative-going bit right at the start is the sync pulse.

 

Thats all I need - cheers !

 

I've realized just now how busy I've been at 'real' work ( :rolleyes: ) to just hook up an o-scope to an output and have a look, I would have seen that dip and used it already - bah!

 

I've been wanting to sync up strobes for instance - but that was a whiles back and the heat isn't on anymore (we used 16mm instead) - sure I'll come up with something else sooner or later

Link to comment
Share on other sites

Bear in mind that's the -line- sync, not the -frame- sync...

 

Ok, I'll admit I'm not a video engineer but I imagine I can use a comparator or similar to get the frequency from that negative pulse and then simply delay the corresponding 'clean' pulse to the position in the cycle that I need ...

 

Yes, there will be some dicking about ;)

Link to comment
Share on other sites

  • 2 weeks later...
File this one under weird ideas:

 

EDIT: Duh, well I've now done a Google search on "HDR video" after I typed all this, so it looks like I've got some reading to do ... :-)

 

....

 

It can be done, and it has been done many times. My company has developed and sold near a million HDR video sensors since 2003. www.pixim.com. Francis Coppola was an early supporter as we wanted to develop something for the entertainment imaging, but nobody cared about HDR, and we end-up focusing on CCTV. Still possible if anyone has deep pockets and wants the edge.

 

Ricardo J. Motta

Link to comment
Share on other sites

  • 2 weeks later...

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
×
×
  • Create New...