A sampling scanner for film archives

[Daniel D. Teoli Jr.]

A good scanner to make for film archives would be a film sampling scanner. Dan Baxter touched on it in another thread. A rough scan to see what you got then work on it later for a better scan if it warrants it. The sampling scanner could be set for scanning every 8, 12, 14, or 24 frames. It would then spit out a MP4 that could be put in the folder with the film record.

The point of it all is, the scanner could be made cheaper than your normal scanner would cost, and allow film archives to see what is on a film and keep a small sampling for the record.  In the past if I wanted a sample done, I'd have to look at the individual frame scans and take out frames by hand to make a sampling of the film.

Maybe the sample scanner could have a setting for speed as well when exporting the MP4. Say 50% to 250% range. Just don't get too anal with all the crap where you need remote learning for 2 days to run it. Sure, you can do all this stuff in post. But the point of a sampling scanner is to make the work fast and easy to do right then and there and not let the work pile up to be revisited. Revisiting work is a big problem. Work piles up and new work comes online, you forget what needs to be done with the old work, or at least waste time trying to figure out where you left off. 

I don't know how this would work; it is just an idea that may make life easier for the film archivist. I'll have to do the same thing I tell the people here to do...test it out to see what the results looks like. I've made a lot of films with still photos for the entire film, but never with the idea of sampling a film. 

<><><><>

New Year's Eve - Skid Row Bar 1971 (Candid)

Photo: D.D.Teoli Jr.

I shot it when I was 17. I looked old for my age and was able to sneak into the bars. Now that I am in my 70's, looking old for your age loses some of its luster.

Daniel D. Teoli Jr. Archival Collection
Daniel D. Teoli Jr. Small Gauge Film Archive
Daniel D. Teoli Jr. Advertising Archive
Daniel D. Teoli Jr. VHS Video Archive
Daniel D. Teoli Jr. Popular Culture Archive
Daniel D. Teoli Jr. Audio Archive
Daniel D. Teoli Jr. Social Documentary Photography
 

Edited April 9 by Daniel D. Teoli Jr.

[Daniel D. Teoli Jr.]

OK, here is a proof-of-concept type of thing...aka a testing of my 'sampling scanner' idea. 

.3 Second Sampler Of Breast Reduction Film D. D. Teoli Jr. A. C. : D. D. Teoli Jr. A. C. : Free Download, Borrow, and Streaming : Internet Archive

Surgery of breasts being reduced.

I tested various speeds and .3 seconds seemed to be the sweet spot between .3, .5 and 1 second for the test times. I had all these photos from when I scanned this film with a Retroscan years ago. I can't remember how many photos were in the scan, maybe 25,000 to 30,000. Whatever it was, it took a long time to grab stills. And these are not regulated as far as number of frames between images - just grabbed some frames at random.  

Well, too bad film is a dying area or maybe some company/s would make such a sampling scanner and make it affordable.

[Daniel D. Teoli Jr.]

You can see that you don't need that many frames from a film to get the flavor of it. 

Retroscan output: DDTJRAC

This sample section could be summed up in 2 frames.

Maybe a sampling scanner could be set via footage if it is easier than counting frames. 6", 12", 18", 24" 36"

If you're like me (short on time and overloaded with work and films) and don't want to bother with a Zeiss viewer any longer, just set up the film on the rewinds and loupe every 10 - 20 feet or so. 

[Dan Baxter]

On 4/9/2024 at 10:16 PM, Daniel D. Teoli Jr. said:

A good scanner to make for film archives would be a film sampling scanner. Dan Baxter touched on it in another thread. A rough scan to see what you got then work on it later for a better scan if it warrants it. The sampling scanner could be set for scanning every 8, 12, 14, or 24 frames. It would then spit out a MP4 that could be put in the folder with the film record.

This already exists. I don't understand what the point in purposefully dropping frames would be given you have to transport the entire length of the film anyway.

On 4/9/2024 at 10:16 PM, Daniel D. Teoli Jr. said:

The point of it all is, the scanner could be made cheaper than your normal scanner would cost, and allow film archives to see what is on a film and keep a small sampling for the record.  In the past if I wanted a sample done, I'd have to look at the individual frame scans and take out frames by hand to make a sampling of the film.

How can it be made any cheaper than what's already available??

Evaluation scans can be done on existing scanning machines, also Filmic is pretty much designed exactly to give you this as it comes with a condition report on the film.

On 4/9/2024 at 10:16 PM, Daniel D. Teoli Jr. said:

Maybe the sample scanner could have a setting for speed as well when exporting the MP4. Say 50% to 250% range. Just don't get too anal with all the crap where you need remote learning for 2 days to run it. Sure, you can do all this stuff in post. But the point of a sampling scanner is to make the work fast and easy to do right then and there and not let the work pile up to be revisited. Revisiting work is a big problem.

Well there you go, you've hit your first major limitation. Most scanners don't go direct to MP4.

What's wrong with using the existing technology to achieve the sampling scans as you call them?

[Perry Paolantonio]

51 minutes ago, Dan Baxter said:

Well there you go, you've hit your first major limitation. Most scanners don't go direct to MP4.

The ScanStation does. The majority of the scans we do include a second MP4 access copy in HD with a one-light grade. The file h is more or less blu-ray spec and will just play on most televisions off a USB thumb drive, at its native frame rate (much nicer than making optical discs and having to do frc and all that). We would never scan to MP4 only unless the purpose of the project was to create a digital reference library of a film collection. It'd be a waste of the client's money to pay us to do a scan to such a lousy format. But it's great for just seeing what you have. 

On 4/9/2024 at 11:36 AM, Daniel D. Teoli Jr. said:

You can see that you don't need that many frames from a film to get the flavor of it. 

I get your point, but as Dan Baxter said, it's kind of weird when the scanner has to go past every frame anyway. Why not just capture them all and make a low res access copy you can watch, which will tell you far more about the film than a page of thumbnail images? That is kind of what he Filmic is made for. 

About 6-7 years ago at NAB, MWA partnered with a company that used a modified version of the MWA Spinner to output essentially what you're showing - it was designed to evaluate the film: it looked for defects, it generated thumbnail images, it  figured out shrinkage percentages, etc. I forget what the software was called but it was basically an add-on to the MWA Spinner and I think the company that made it (the software) was also German.  The result was a PDF report, I think. 

Of course, one could generate similar reports from other software working on full scans of the film. That's something that could be done in software.

[Daniel D. Teoli Jr.]

I tested out this concept in 2 other speeds - .10 seconds & .20 seconds per sample frame.

It is something. You can reduce a 15 or 20 minute film down to a few seconds and still get a decent feel for it.

.10 seconds per frame:

Breast Reduction Surgery Sampler Test .10 Sec Per Frame 22 Sec Total D. D. Teoli Jr. A. C. : D. D. Teoli Jr. A. C. : Free Download, Borrow, and Streaming : Internet Archive

.20 seconds per frame:

.20 Second Sampler Of Breast Reduction Film D. D. Teoli Jr. A. C. : D. D. Teoli Jr. A. C. : Free Download, Borrow, and Streaming : Internet Archive

Now the only problem is how to do it on a fast and affordable basis. This is especially useful plan if you have many hundred 'pig in a poke' home movies as I do. You can only put so much info in the description. And words can never take the place of seeing it.

Stock footage companies could probably benefit from this technique as well. Both for their own internal use and for their customers use. It would make it easier for their clients to sift through the material to buy. Once the customer finds films with potential they can view the entire reel.

Call it the 'Synopsis of Film' or 'Visual Synopsis of Film.'

In the end we both do the same thing; it is just that I archive films to donate to the historical record, whereas they do it to sell by the second. 

 

 

Edited April 16 by Daniel D. Teoli Jr.

[Perry Paolantonio]

My point is that you shouldn't do this in the scanner. It's not saving you any time. 

If you're only scanning 1/3 of the frames in a film in order to make thumbnails, you still need to move from the beginning of the film to the end. That is, all frames have to pass through the scanner even if all frames aren't being scanned. The time it takes to shuttle from frame one to frame 5 on a scanner like the scanstation is longer than the time it takes to simply scan frames 1-5, because the scanner has to stop, switch to shuttle mode, shuttle, take an image to make sure it's in the right place, adjust if not, then take the image. rinse. repeat. All that takes more time -by a lot- than just scanning straight through. You can do what you want (grab every X frames) in software on the resulting scan of every frame. then you have both things. 

 

[Daniel D. Teoli Jr.]

When you do your tests, always go the distance...from the alpha to the omega. I tried a few other times with this test, but didn't post them. I found 1 second is too long and .05 seconds is too short. It looks like .20 or .30 of a second per frame is the sweet spot.