KronTalk

Chronos => Chronos User Discussion => Topic started by: tesla500 on February 20, 2018, 12:13:23 AM

Title: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 20, 2018, 12:13:23 AM
For those of you itching to shoot RAW on your Chronos, you can now use the raw saving feature in the latest beta software v0.2.5 (http://forum.krontech.ca/index.php?topic=105.0) along with this new conversion tool to make DNG sequences. This method of saving raw is only recommended for legacy workflows, the CinemaDNG saving option should be uses in most cases.

pyraw2dng converts the .raw files saved by Chronos to standard Adobe DNG files.

The pyraw2dng utility is open source, you can view the source code on Github:
https://github.com/krontech/chronos-utils/tree/master/python_raw2dng

Requirements

Python 2.7, available here: https://www.python.org/downloads/release/python-278/
This might work in Python 3 as well, but it has not been tested.

During the Windows Python 2.7 installation, ‘install’ "Add Python.exe to Path" as shown below:

(http://forum.krontech.ca/index.php?action=dlattach;topic=132.0;attach=125;image)

Usage

Save your video using the RAW16bit format on the camera. Raw16RJ works, but the images are dark and need to be fixed in post.

Download the script (see link above)

Copy the script file, pyraw2dng.py and the raw 16 bit format video into the same directory.

Open a terminal (command prompt), then navigate to the folder with your videos and script

Execute the script as shown in the example below. You will need to update the -w and -l switches with your actual frame size.
pyraw2dng.py -w (width) -l (length) (filename)

Where:
(width) is the horizontal resolution of your recording
(length) is the vertical resolution of your recording
(filename) is the .raw file you want to convert

An example of a complete command is shown below:
pyraw2dng.py -w 1280 -l 1024 vid.raw

The raw video will be converted and saved as a DNG sequence in a folder of the same name as the .raw file.

Let us know how this works for you!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 20, 2018, 08:24:51 AM
It might be useful if you could post here the advantages of shooting RAW with the Chronos...
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 20, 2018, 12:21:56 PM
It might be useful if you could post here the advantages of shooting RAW with the Chronos...

I'll let this comparison speak for itself:

(http://forum.krontech.ca/index.php?action=dlattach;topic=132.0;attach=132;image)

Advantages of RAW are far greater control of the image processing pipeline, better color correction, better demosaic, etc. This ultimately results in far sharper and more accurate images than the current in-camera processing provides.

Better in-camera processing is on the way, eventually you should expect in-camera to be almost as good as the raw samples.

You can also find the full scenes, and dng attached.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 20, 2018, 12:40:04 PM
Well that's very dramatic. Much more so that I'd see with a jpg/RAW comparison from a DSLR.
Needless to say, I'll be shooting RAW from now on!

Is there any chance of posting a road map of the various key firmware improvements you're working on so we'd get an idea of which will be available when?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: JamesB on February 20, 2018, 03:38:28 PM
Wonder if it would be possible to save both RAW data and H.264 of the same clip automatically in a future firmware. Without having to change settings and save each one separately. That way it will be like RAW + JPG on still cameras.   The detail improvement with RAW is like getting a new camera.   Will test in the next few days.   ;D
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Jeffism on February 20, 2018, 05:42:15 PM
Wow, the difference is much greater than I expected. The details on the stick of RAM and the colours of the cables  :o
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: gyppor on February 20, 2018, 07:38:27 PM
Wow, that's dramatic. Really dramatic. I've never shot raw before but I'm going to take the plunge, 100%.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on February 21, 2018, 07:29:11 AM
wow those differences are dramatic!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 21, 2018, 10:23:32 AM
This is going to help a lot when lighting conditions are not as good as we'd like them to be.

I've done a couple of quick tests and this is the workflow I've used for them as it may help you if you want to try recording in RAW mode.

1. Generate .raw file as David outlines above
2. In Adobe Bridge, open the first .DNG file as a Camera Raw file and tweak exposure, sharpness, colour etc. As the DNG is a raw file format you can do a lot here to improve the overall look and quality of each frame
3. Apply changes to all the DNG files and save them. I save them as .JPGs for the next step
4. In Photoshop, Open As... Image sequence and pull in all the JPGs
5. Export... Render Video and save whatever video format and quality you want to use. I've used Adobe H264 max. quality for these test.

The light was really dull when I took these, so the processed RAW version does have quite a lot of noise, but it's a massive improvement from the original and a much better result than I achieved tweaking the brightness, contrast and colour in my edit software.

Here's an original untouched frame from the Chronos H264 version of the clip I saved:
(https://i.imgur.com/mC6zk23.jpg)
Here's a frame from the final video I rendered from PS:
(https://i.imgur.com/SFFLG16.jpg)

Here are the links to the videos:

Original from Chronos:
https://youtu.be/6JMfVIYYci0

Original tweaked in edit software:
https://youtu.be/upStvyZh9U0

RAW version tweaked in PS:
https://youtu.be/Dk1ShX0J8WI
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on February 21, 2018, 09:59:11 PM
so i tried my first save a raw file today and it froze and stoped pretty early on i looked at the file on the card and its 4.29 gb do you know why it may have stoped saving and froze? it saved  the h264 just fine before that
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 21, 2018, 10:16:56 PM
so i tried my first save a raw file today and it froze and stoped pretty early on i looked at the file on the card and its 4.29 gb do you know why it may have stoped saving and froze? it saved  the h264 just fine before that

How long did it take to freeze approximately? There's currently a limitation with FAT32 formatted cards, they can't handle files over 4GB, if the file you saved was larger that would explain the problem. You can try an EXT3 formatted card if you want to save larger files. exFAT and NTFS support is in the works so this will be solved.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: jasonfish on February 21, 2018, 10:36:40 PM
Here are the links to the videos:

Original from Chronos:
https://youtu.be/6JMfVIYYci0

Original tweaked in edit software:
https://youtu.be/upStvyZh9U0

RAW version tweaked in PS:
https://youtu.be/Dk1ShX0J8WI

That's just extraordinary.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 22, 2018, 01:13:05 AM
The 4GB limit is going to be an issue when saving in RAW mode, so I'm hoping you can solve it soon!

I tried EXT3 formatting, but I couldn't get it to work.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on February 22, 2018, 05:41:53 AM
so i tried my first save a raw file today and it froze and stoped pretty early on i looked at the file on the card and its 4.29 gb do you know why it may have stoped saving and froze? it saved  the h264 just fine before that

How long did it take to freeze approximately? There's currently a limitation with FAT32 formatted cards, they can't handle files over 4GB, if the file you saved was larger that would explain the problem. You can try an EXT3 formatted card if you want to save larger files. exFAT and NTFS support is in the works so this will be solved.

At least 5-10minutes it was saving at 3-5fps I think
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 22, 2018, 07:58:31 PM
At least 5-10minutes it was saving at 3-5fps I think

That lines up with the 4GB limit. The camera should warn you about this, this was added between v0.2.3 and 0.2.5, which version are you on?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 25, 2018, 09:27:56 AM
I have made some raw recordings at different resolutions but didn't make a note of the settings.

How can I find out what length and width to put into the script just from the RAW file?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: JamesB on February 25, 2018, 06:30:49 PM
Well, I tested the heck out of the RAW recording this weekend and I am very impressed with the quality gains. So much so that H.264 seems to be an easy way to destroy your image information.  I believe there should be a way of improving the h.264 output to offer better de-bayering even at the cost of encoding speed.  If DSLRs and Mirrorless cameras can offer h.264 free of most Bayer artifacts the Chronos should be able to do so as well. You will still have less dynamic range and much less color information but at least the color border artifacts should be gone.

I ran into problems with file size as well so the 4GB limit warning was good but it came up even when the file to be saved was just 1.8GB So there is no way of telling.  Your best bet is to have ample card speed and do attempts.   My average RAW file size was 1.67GB by just saving a small part of the action which is always trying to capture what is best.  I had to fill 2 32GB cards in my tests.  Sadly I read that the 12 bit compact RAW is not yet supported but will be so I'll have to wait for that to materialize to see the output.  I also recorded an h.264 version of most clips so I could see the gains in quality.

Much to my surprise H.264 in camera is a horrible conversion compared to the RAW data debayer in Camera RAW, much more so than I expected based on the Krontech frames that were shared.   Noise is still a problem for the RAW files but the extra information and ability to reduce color and luminance noise in Camera RAW before developing is very nice.  The Amount of detail preserved is night and day. Dynamic range is also fantastic by comparison, no contest... the ability to white balance after the fact can also not be understated.  The DNG Converter does a great job with no quality degradation well-done team!

Things that can improve: 

1) Ability to save H.264 and RAW at the same time so you can leave the camera unattended as it takes sometimes 10+min to save a RAW file. Always good to have the H.264 just in case.

2) Ability to eject the SD Card from the save clip dialogue as I ran out of space before saving one time, it would be nice to be able to swap from the saving dialogue box without corruption possibility if force ejected.

3) Camera locked up when card filled and had to do a hard reset. There was a dialogue that said something about card space and I said ok and camera locked up.  Abort button did not respond.

4) When shooting in 720p or lower resolution it would be great to have the button / scrollbar interface on the bottom to amplify the screen real estate and see a larger preview. Only full sensor size seems to require interface to the right. A simple orientation switch would be great.

5) Of course DNG direct from camera which is coming but also a chance to take a second look at H.264 and try to improve the output, the encoder is not doing a proper job of preserving detail and could really be a near RAW detail image without all of these artifacts on edges jumping out.  Most cameras from big manufacturers can do extremely clean H.264 requiring RAW only in specialized situations.  Even if the speed on saving is sacrificed H.264 high-quality encoding should be on the timeline for a software update.  Fingers Crossed X

I am including a frame from RAW and H.264 from one of the videos side by side. Look at the detail and water patterns for artifacts on the H.264, it is night and day difference.  Chronos 1.4 comes alive with RAW.  ;)

Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 26, 2018, 01:58:59 AM
Absolutely agree with all of that. RAW is the only way to go IMO but to make it usable we need:

Remove 4GB filesize limit
Speed up write to the SD/USB
Include metadata somehow with each recording

I'm happy to do a lot of post processing as that can be largely automated and I am about to order a nice new i7 8700-based PC :)
RAW+jpg would be nice, but not if it impacts on save time too much.

Of course, if all of this can be achieved once we have tethered ethernet working, that will probably be the better way to go anyway.

I still need some way to find out what resolution is of some of the raw files I recorded yesterday...

Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 26, 2018, 01:07:42 PM
I have made some raw recordings at different resolutions but didn't make a note of the settings.

How can I find out what length and width to put into the script just from the RAW file?

You'll need to use trial and error for now, unfortunately. Try different values for horizontal resolution, leaving the vertical resolution set to 1024, until you get an image that looks clear. Once you have horizontal resolution set correctly, it's much easier to figure out the proper vertical resolution just by looking at the output image.

This conversion tool is very much a stopgap measure until we have this functionality built into the camera.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on February 26, 2018, 01:16:24 PM
Well, I tested the heck out of the RAW recording this weekend and I am very impressed with the quality gains. So much so that H.264 seems to be an easy way to destroy your image information.  I believe there should be a way of improving the h.264 output to offer better de-bayering even at the cost of encoding speed.  If DSLRs and Mirrorless cameras can offer h.264 free of most Bayer artifacts the Chronos should be able to do so as well. You will still have less dynamic range and much less color information but at least the color border artifacts should be gone.

I ran into problems with file size as well so the 4GB limit warning was good but it came up even when the file to be saved was just 1.8GB So there is no way of telling.  Your best bet is to have ample card speed and do attempts.   My average RAW file size was 1.67GB by just saving a small part of the action which is always trying to capture what is best.  I had to fill 2 32GB cards in my tests.  Sadly I read that the 12 bit compact RAW is not yet supported but will be so I'll have to wait for that to materialize to see the output.  I also recorded an h.264 version of most clips so I could see the gains in quality.

Much to my surprise H.264 in camera is a horrible conversion compared to the RAW data debayer in Camera RAW, much more so than I expected based on the Krontech frames that were shared.   Noise is still a problem for the RAW files but the extra information and ability to reduce color and luminance noise in Camera RAW before developing is very nice.  The Amount of detail preserved is night and day. Dynamic range is also fantastic by comparison, no contest... the ability to white balance after the fact can also not be understated.  The DNG Converter does a great job with no quality degradation well-done team!

Things that can improve: 

1) Ability to save H.264 and RAW at the same time so you can leave the camera unattended as it takes sometimes 10+min to save a RAW file. Always good to have the H.264 just in case.

2) Ability to eject the SD Card from the save clip dialogue as I ran out of space before saving one time, it would be nice to be able to swap from the saving dialogue box without corruption possibility if force ejected.

3) Camera locked up when card filled and had to do a hard reset. There was a dialogue that said something about card space and I said ok and camera locked up.  Abort button did not respond.

4) When shooting in 720p or lower resolution it would be great to have the button / scrollbar interface on the bottom to amplify the screen real estate and see a larger preview. Only full sensor size seems to require interface to the right. A simple orientation switch would be great.

5) Of course DNG direct from camera which is coming but also a chance to take a second look at H.264 and try to improve the output, the encoder is not doing a proper job of preserving detail and could really be a near RAW detail image without all of these artifacts on edges jumping out.  Most cameras from big manufacturers can do extremely clean H.264 requiring RAW only in specialized situations.  Even if the speed on saving is sacrificed H.264 high-quality encoding should be on the timeline for a software update.  Fingers Crossed X

I am including a frame from RAW and H.264 from one of the videos side by side. Look at the detail and water patterns for artifacts on the H.264, it is night and day difference.  Chronos 1.4 comes alive with RAW.  ;)

I absolutely agree with you there, the in-camera processing needs a lot of improvement. The current project is still Ethernet control, which is turning out to be a much larger project that anticipated. Once that's done we'll be working on a better in-camera video pipeline, the primary goals are better democratic (Likely AHD, same as used by Adobe Camera RAW last time I checked), as well as better color processing. I believe this will fix the h264 quality issues.

Metadata, large file support and write speed increases are also in the works. Right now, you can work around these issues by using an EXT3 formatted eSATA or USB hard drive. Write speeds up to 30MB/s should be achievable currently.

Combined h264 and RAW saving is something we can do shortly as well.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: JamesB on February 26, 2018, 01:38:59 PM
Thanks, David, it is really encouraging to see the Chronos starting to mature into a dependable professional tool.   Excited by the upcoming possibilities from you and the development team.  :D
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 27, 2018, 12:46:20 AM
I have made some raw recordings at different resolutions but didn't make a note of the settings.

How can I find out what length and width to put into the script just from the RAW file?

You'll need to use trial and error for now, unfortunately. Try different values for horizontal resolution, leaving the vertical resolution set to 1024, until you get an image that looks clear. Once you have horizontal resolution set correctly, it's much easier to figure out the proper vertical resolution just by looking at the output image.

This conversion tool is very much a stopgap measure until we have this functionality built into the camera.

Ok I guessed the right number, so I can process those raw files now! Thanks.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on February 28, 2018, 08:13:25 AM
I've now managed to get over the 4GB limit using the method Dan D found, but on a Windows 10 PC.

If you want to save RAW files larger than 4GB, here's what you do:

Download and install the free utilities 'MiniTool Partition Wizard Free' and 'Ext2Fsd'.
Format a USB stick or SD card as EXT3 using MiniTool Partition Wizard. I've used a 128GB USB stick successfully.
Plug it into the Chronos and select it in the Save Location dropdown. If it doesn't appear, something's gone wrong with the formatting of the drive.
Record and save to the EXT3 drive (when you get the 4GB warning message just tell it to save anyway.)
When finished saving, plug the card/stick into your PC and use Ext2Fsd to copy the contents to an NTFS drive. 

I just did this with a 21GB recording. It took 47 minutes to save to the stick, but we know it's going to be slow at the moment.
The main thing is it worked I don't have the 4GB limit any more.

I think I better free up some hard drive space now  ;D
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on March 06, 2018, 12:48:26 PM
For those of you itching to shoot RAW on your Chronos, you can now use the raw saving feature in the latest beta software v0.2.5 (http://forum.krontech.ca/index.php?topic=105.0) along with this new conversion tool to make DNG sequences. This is a stopgap solution until we have DNG saving built into the camera.

pyraw2dng converts the .raw files saved by Chronos to standard Adobe DNG files.

The pyraw2dng utility is open source, you can view the source code on Github:
https://github.com/krontech/chronos-utils/tree/master/python_raw2dng

Requirements

Python 2.7, available here: https://www.python.org/downloads/release/python-278/
This might work in Python 3 as well, but it has not been tested.

During the Windows Python 2.7 installation, ‘install’ "Add Python.exe to Path" as shown below:

(http://forum.krontech.ca/index.php?action=dlattach;topic=132.0;attach=125;image)

Usage

Save your video using the RAW16bit format on the camera. Raw16RJ works, but the images are dark and need to be fixed in post. RAW12bit packed mode is not yet supported, but is coming soon.

Download the script (see attachment)

Copy the script file, pyraw2dng.py and the raw 16 bit format video into the same directory.

Open a terminal (command prompt), then navigate to the folder with your videos and script

Execute the script as shown in the example below. You will need to update the -w and -l switches with your actual frame size.
pyraw2dng.py -w (width) -l (length) (filename)

Where:
(width) is the horizontal resolution of your recording
(length) is the vertical resolution of your recording
(filename) is the .raw file you want to convert

An example of a complete command is shown below:
pyraw2dng.py -w 1280 -l 1024 vid.raw

The raw video will be converted and saved as a DNG sequence in a folder of the same name as the .raw file.

Let us know how this works for you!
   how do you execute the script can you post screenshots for us not familiar with terminal?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on March 07, 2018, 03:15:36 AM
Quote from: patrickrebstock
how do you execute the script can you post screenshots for us not familiar with terminal?


Are you PC-based?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on March 07, 2018, 05:20:41 PM
Quote from: patrickrebstock
how do you execute the script can you post screenshots for us not familiar with terminal?


Are you PC-based?
i have a pc and a mac
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: John Delonghi on March 08, 2018, 01:37:52 AM
As long as you've installed Python as David details, the easiest way is to create a folder on your PC, copy the pyraw2dng.py file and your .raw file from the Chronos into it, then create a batch file to run it.

I've attached an example .bat file you can use.

So, in the folder you should have test.bat, test.raw and pyraw2dng.py. Edit your .bat file with a text editor to get the resolution and raw filename correct then just double click the test.bat file and it should run.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Sorchey on April 04, 2018, 01:59:26 PM
Once that's done we'll be working on a better in-camera video pipeline, the primary goals are better democratic (Likely AHD, same as used by Adobe Camera RAW last time I checked), as well as better color processing. I believe this will fix the h264 quality issues.

I've just seen this thread and I'm symply blown away by the comparison between RAW and h264.

Although it is a very unpopular question, could you predict a rough time schedule for this update? Can we expect something in that direction this year, maybe this summer?

Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on April 06, 2018, 07:03:09 PM
I've just seen this thread and I'm symply blown away by the comparison between RAW and h264.

Although it is a very unpopular question, could you predict a rough time schedule for this update? Can we expect something in that direction this year, maybe this summer?

We're going to get the color improvements into v0.3. The release candidate was going to go out this week but we delayed to get the color changes in, check the Software Dev forum over the next week or two for the release candidate.

Better demosaic is going to be in V0.4 or V0.5 sometime late spring or early summer.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: JamesB on April 10, 2018, 01:18:02 PM
Great news, also would love to get the compressed RAW converter option soon as I have a list of clips that are just sitting there. It also makes for faster storage in the field, regular RAW just eats up cards for lunch. 

I am very happy with the RAW quality and after using it, H.264, as it is right now, is not worth it even for the speed.  Also with proper and often black calibration, most banding is taken care of.   

A 10-bit version of H.265 or a 4:2:2 H.264 variant with better demosaic algo would make this amazing for speed and quality. 

It would also be so cool if we could have a daylight balance preset for the WB. Maybe be able to save a previous WB in a file as balancing every time is an extra step.  Most of us either shoot in our studio or outside needing only 2 WB presets.  For a later build of course.   Great job so far David!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: lwaters on April 11, 2018, 06:30:30 AM
Hi,
 
So happy with the camera update and the raw files we have now! For what we are working on though, we need BMP files...does anyone have any suggestions on conversion or any other ideas on how we could get there? Even a code in python or something?

Thank you :)

Laura
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: tesla500 on April 12, 2018, 01:00:25 AM
Hi Laura,

Try converting the raw file to DNG using the tool, DNG is just a specialized form of TIFF, image editors may be able to open the DNG as a monochrome 16-bit TIFF.

David
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: nik282000 on April 21, 2018, 07:44:29 PM
Just wanted to chime in about RAW workflow.

I am using a 128GB USB drive formatted to EXT3 to save files from the camera and avoid the 4GB limit of FAT32, this works perfectly. To get the raw files onto a windows PC I use the software "ext2explore," it's a little clunky but it will get the job done. The pyraw2dng also works perfectly, even with raw files that were broken by the FAT32 limit and my own clumsiness.

To convert the DNG files to 'normal' images I am using Rawtherapee, an image editor meant to be an alternative to Adobe Lightroom. Rawtherapee allows for batch processing of files, so I make my adjustments to one frame and apply them to the whole set, I've done about 8000frames in one go with no problem. Once I have a folder full of PNGs I assemble them into a video file using VirtualDub, this allows you to set the final frame-rate of the video and export it as a raw or compressed AVI file.

All the tools used are free (as in beer) software and the only real limiting factor for any step in the process is time and processing power.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: lwaters on May 08, 2018, 05:15:22 AM
Thank you both for your responses!
I've been using a trial version of Camera Raw & Photoshop to convert for now...once they are in tiff format we bring them into PFV viewer to analyze the video...but I am in the process of downloading VirtualDub and Rawtherapee now!
Thank you both so much.
Have a great week!
Laura
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: BlackthorneMedia on May 16, 2018, 09:38:10 AM
Anyone have a tool for formatting SD cards in ext3 on a mac.

I have followed every tutorial out there and cant get any of the mac options to work.

I have tried e2fsprogs (sudo $(brew --prefix e2fsprogs)/sbin/mkfs.ext3 /dev/diskN) and it just errors out. I am troubleshooting as I go but am hoping someone else has a workaround.

Anyone else have a tool or shortcut.

By the way pyraw2dng is working GREAT! The image quality is night and day!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Mario3005 on May 16, 2018, 10:26:29 AM
That should work with the preinstalled Program Disk Utility on a Mac.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Newbee on May 19, 2018, 04:22:55 AM
I could not use pyraw2dng on Mac with python3.
Did you use pyraw2dng on Mac?
How can I do?

Anyone have a tool for formatting SD cards in ext3 on a mac.

I have followed every tutorial out there and cant get any of the mac options to work.

I have tried e2fsprogs (sudo $(brew --prefix e2fsprogs)/sbin/mkfs.ext3 /dev/diskN) and it just errors out. I am troubleshooting as I go but am hoping someone else has a workaround.

Anyone else have a tool or shortcut.

By the way pyraw2dng is working GREAT! The image quality is night and day!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: BlackthorneMedia on May 19, 2018, 02:22:37 PM
I actually got both to work, but I had to do a complete reinstall of e2fsprogs via brew for Mac. Once I installed it that way it worked and I can now ext3 format my SD cards. All the info I found on the net for installing it via brew were old and dont work with the current version of brew.

Quote
I could not use pyraw2dng on Mac with python3.
Did you use pyraw2dng on Mac?
How can I do?


Make sure you are putting ./ in front of the commands after doing the things listed in this thread.

Long story short, even though you make the script executable, its not recognized as a program at the command prompt and you have to add ./ before the command to et MacOS know its a script

For example:

./pyraw2dng.py -w 1280 -l 720 inputfilename.raw
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Newbee on May 20, 2018, 03:24:56 AM
Thank you for your reply.

I tried as you said.
but it didn't work.

This is error code.
======================================================
AKIOnoiMac:Downloads mycomputer$ ./pyraw2dng.py -w 1280 -l 1024 vid.raw
-bash: ./pyraw2dng.py: Permission denied
AKIOnoiMac:Downloads mycomputer$ sudo ./pyraw2dng.py -w 1280 -l 1024 vid.raw
sudo: ./pyraw2dng.py: command not found
======================================================

Is there something wrong with my method?
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: BiduleOhm on May 20, 2018, 03:27:09 AM
Do:
Code: [Select]
sudo chmod +x pyraw2dng.py
Then retry your command (without sudo, shouldn't be needed here).
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: BlackthorneMedia on June 20, 2018, 04:22:07 AM
Yes, forgot that you ahve to make it executable.

That and please make sure you are running the command from the directory where the script is.

E.G. cd (change directory) so you run the command from the folder where the script and files are.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: twistedmesses on August 13, 2018, 06:30:53 PM
I've gone down the RAW rabbit hole and the results are so good it makes it painful to use the standard compression now. Thanks to everyone that gave instructions on what worked for them, helped me tremendously.

Just curious if the current workflow is the same for everyone or if there have been optimized processes since a few months ago.

Currently have a 128gig USB formatted to EXT3 to save everything over 4gigs then using pyraw2dng to convert into DNG and then After Effects makes the video creation super easy. Firmware is updated to most recent version.

I guess I'm wondering if there is a faster way to get RAW vids out of the chronos 1.4. Is ethernet the only other option? Has anyone tried ethernet transfer?  Wondering if Ethernet cable somehow rigged into a portable hard-drive would be possible. With live subjects it's gonna be hard to wait 30mins between each shoot while the video saves.

Any suggestions would be very appreciated.

Thanks
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: patrickrebstock on August 21, 2018, 10:34:50 AM
Can someone that really understands the RAW process, condense the knowledge into a single post with steps  so us non technical noobs can try it out? I would very much appreciate it
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: miloreid on November 05, 2018, 08:29:10 AM
Hi all,

I really want to try out the raw footage on the Chronos but I am struggling to edit the footage. I am a Mac user, can anyone explain how I can create the dng's on a Mac or will I have to use a PC to transcode them?

thanks

Milo
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: skronstein on November 06, 2018, 04:44:11 PM
Hi all,

I really want to try out the raw footage on the Chronos but I am struggling to edit the footage. I am a Mac user, can anyone explain how I can create the dng's on a Mac or will I have to use a PC to transcode them?

thanks

Milo

The 0.3.1-beta-9 version of the camera software can save directly to dng format, no need to transcode. Are you using a monochrome or color camera? DNG's saved directly from a monochrome cameras currently have compatibility issues with some software.  We're working on a fix for this.
If you have to convert a raw file that has already been saved, you can just follow the directions for linux, as they should work on a Mac too. https://github.com/krontech/chronos-utils/blob/master/python_raw2dng/README.md
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: miloreid on November 09, 2018, 06:33:51 AM
Hi thanks for your response,

that great that it now supports the formatting directly I had no idea. I just this minute got it working and thought I would write these very basic directions for anyone else that may need them

Capture raw file  - using 1st option on menu of chronos
Download and install latest version of python 2.7
Copy raw file and pyraw2dng.py file to a certain directory ie documents folder
Open terminal
navigate to the directory your files are stored at by typing the following
cd
Then hit spacebar, navigate to the folder where you files are in the finder and drag and drop into terminal after cd
So it should read something like
cd /users/name/documents
You will now be in the correct directory and need to run the script
./pyraw2dng.py -w 1280 -l 720 inputfilename.raw
it may say there is a permissions issue, in which case type in the following
chmod 777 pyraw2dng.py and hit enter
you may now find that it will come up with an error saying bad interpreter
type in the following
tr -d '\r' < pyraw2dng.py > newpyraw2dng.py
and change permissions again
Chmod 777 newpyraw2dng.py
Finally run the code by typing
./newpyraw2dng.py -w 1280 -l 720 inputfilename.raw
Making sure that you have written the correct proportions that match what you footage was shot at

Now there should be a folder created in the directory your files are in containing a dng for each frame of your video.

I hope that helps someone

Thanks

Milo

Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: Michael M. on January 15, 2019, 11:07:35 AM
Hi thanks for your response,

that great that it now supports the formatting directly I had no idea. I just this minute got it working and thought I would write these very basic directions for anyone else that may need them

Capture raw file  - using 1st option on menu of chronos
Download and install latest version of python 2.7
Copy raw file and pyraw2dng.py file to a certain directory ie documents folder
Open terminal
navigate to the directory your files are stored at by typing the following
cd
Then hit spacebar, navigate to the folder where you files are in the finder and drag and drop into terminal after cd
So it should read something like
cd /users/name/documents
You will now be in the correct directory and need to run the script
./pyraw2dng.py -w 1280 -l 720 inputfilename.raw
it may say there is a permissions issue, in which case type in the following
chmod 777 pyraw2dng.py and hit enter
you may now find that it will come up with an error saying bad interpreter
type in the following
tr -d '\r' < pyraw2dng.py > newpyraw2dng.py
and change permissions again
Chmod 777 newpyraw2dng.py
Finally run the code by typing
./newpyraw2dng.py -w 1280 -l 720 inputfilename.raw
Making sure that you have written the correct proportions that match what you footage was shot at

Now there should be a folder created in the directory your files are in containing a dng for each frame of your video.

I hope that helps someone

Thanks

Milo

Thank you for sharing this, Milo!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: himikk on February 11, 2019, 01:13:38 AM
I can't decode 12 bit compressed RAW format.
When trying to convert it the output DNG files contain color noise and sometimes something similar to out-of-sync frames.

Tested both options '-d' and '--oldpack'; resolution specified correctly; RAW files saved with firmware 0.3
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: skronstein on February 11, 2019, 04:47:38 PM
I can't decode 12 bit compressed RAW format.
When trying to convert it the output DNG files contain color noise and sometimes something similar to out-of-sync frames.

Tested both options '-d' and '--oldpack'; resolution specified correctly; RAW files saved with firmware 0.3

Are you able to use 0.3.1-RC1 instead? It can natively record videos in CinemaDNG format. http://forum.krontech.ca/index.php?topic=434.0

What do you mean by color noise?

The readme says that the old RAW 12bit format has bugs that cause color corruption:
The --oldpack option will attempt to decode the raw file as a 12-bit packed format generated from software versions v0.3.0 and older. However due bugs in this encoding format, there may be off-by-one pixel errors in the encoded files. This is most noticeable as colour corruption after demosiac.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: himikk on February 18, 2019, 09:32:50 AM
I can't decode 12 bit compressed RAW format.
When trying to convert it the output DNG files contain color noise and sometimes something similar to out-of-sync frames.

Tested both options '-d' and '--oldpack'; resolution specified correctly; RAW files saved with firmware 0.3

Are you able to use 0.3.1-RC1 instead? It can natively record videos in CinemaDNG format. http://forum.krontech.ca/index.php?topic=434.0

What do you mean by color noise?

The readme says that the old RAW 12bit format has bugs that cause color corruption:
The --oldpack option will attempt to decode the raw file as a 12-bit packed format generated from software versions v0.3.0 and older. However due bugs in this encoding format, there may be off-by-one pixel errors in the encoded files. This is most noticeable as colour corruption after demosiac.

Some footages already in RAW 12bit so it will be good to convert it but if it does not work out - nothing terrible.
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: clkdiv on May 14, 2020, 01:00:17 PM
Hello nice girls and guys,

I accidently recorded 12 bit RAW and really would like to convert the raw files to DNG, but I can't make it work. I recorded at full res 1000fps, newest software beta release "chronos-unstable-20200508.img".

Using "pyraw2dng.py -C -w 1920 -l 1080 [filename.raw]" gives me sort of distorted image, don't know what that means. I attached a frame. Can anyone help me to rescue the footage? Thanks a lot!
Title: Re: Chronos 1.4 RAW conversion tool - pyraw2dng
Post by: clkdiv on May 14, 2020, 01:17:42 PM
Ok, sorry! I now made it work. Somehow I had a newer or at least different version downloadable from https://github.com/krontech/chronos-utils/tree/master/python_raw2dng (https://github.com/krontech/chronos-utils/tree/master/python_raw2dng).

However, my version did not support 12 bit RAW. Thanks!