starred/photoprism

Fork 0

mirror of https://github.com/photoprism/photoprism.git synced 2026-03-02 22:57:18 -05:00

Indexing: Converting certain Sony ARW-Files fails (no JPG files created) #2148

New issue

Closed

opened 2026-02-20 01:07:03 -05:00 by deekerman · 5 comments

deekerman commented

2026-02-20 01:07:03 -05:00

Owner

Originally created by @dinoschachten on GitHub (Jul 18, 2024).

I have a number of files that I shot with a Sony a7IV, utilising the compressed RAW setting "S".

During indexing I get the following output, which looks to me like both darktable and rawtherapee attempt to convert, but fail:

2024-07-18 15:07:00 INFO convert: converting DSC02730.ARW to DSC02730.ARW.jpg (rawtherapee-cli)

2024-07-18 15:07:00 INFO convert: converting DSC02731.ARW to DSC02731.ARW.jpg (rawtherapee-cli)

2024-07-18 15:06:59 INFO convert: converting DSC02731.ARW to DSC02731.ARW.jpg (darktable-cli)

2024-07-18 15:06:59 INFO convert: converting DSC02730.ARW to DSC02730.ARW.jpg (darktable-cli)

2024-07-18 15:06:58 INFO convert: converting DSC02728.ARW to DSC02728.ARW.jpg (rawtherapee-cli)

2024-07-18 15:06:58 INFO convert: converting DSC02729.ARW to DSC02729.ARW.jpg (rawtherapee-cli)

2024-07-18 15:06:56 INFO convert: converting DSC02729.ARW to DSC02729.ARW.jpg (darktable-cli)

2024-07-18 15:06:56 INFO convert: converting DSC02728.ARW to DSC02728.ARW.jpg (darktable-cli)

2024-07-18 15:06:55 INFO convert: converting DSC02726.ARW to DSC02726.ARW.jpg (rawtherapee-cli)

2024-07-18 15:06:55 INFO convert: converting DSC02727.ARW to DSC02727.ARW.jpg (rawtherapee-cli)

2024-07-18 15:06:54 INFO convert: converting DSC02727.ARW to DSC02727.ARW.jpg (darktable-cli)

2024-07-18 15:06:54 INFO convert: converting DSC02726.ARW to DSC02726.ARW.jpg (darktable-cli)

For the affected RAW files, no JPG files are created in the sidecar directory, and subsequently no YML files either.

Curiously, DigiKam (using LibRaw for RAW conversion) marks these RAW files as "TIFF" (but displays them correctly) while other RAW files from the same camera at different compression settings are marked as "ARW" as they should.

Not sure if this is something that can or should be fixed within Photoprism (in the way that rawtherapee and darktable are utilised), or if this is simply a shortcoming of both of the utilised conversion tools...

As this probably doesn't affect many users, and I myself don't intend on using this specific RAW compression setting, I am perfectly fine with this ending up as a "won't fix".

I just thought you should know in case this is an easy fix, or in case there has been contemplation regarding changes of tools or settings for RAW conversion that this might factor into.

I will provide a sample file and reference this issue.

Originally created by @dinoschachten on GitHub (Jul 18, 2024). I have a number of files that I shot with a Sony a7IV, utilising the compressed RAW setting "S". During indexing I get the following output, which looks to me like both darktable and rawtherapee attempt to convert, but fail: ``` 2024-07-18 15:07:00 INFO convert: converting DSC02730.ARW to DSC02730.ARW.jpg (rawtherapee-cli) 2024-07-18 15:07:00 INFO convert: converting DSC02731.ARW to DSC02731.ARW.jpg (rawtherapee-cli) 2024-07-18 15:06:59 INFO convert: converting DSC02731.ARW to DSC02731.ARW.jpg (darktable-cli) 2024-07-18 15:06:59 INFO convert: converting DSC02730.ARW to DSC02730.ARW.jpg (darktable-cli) 2024-07-18 15:06:58 INFO convert: converting DSC02728.ARW to DSC02728.ARW.jpg (rawtherapee-cli) 2024-07-18 15:06:58 INFO convert: converting DSC02729.ARW to DSC02729.ARW.jpg (rawtherapee-cli) 2024-07-18 15:06:56 INFO convert: converting DSC02729.ARW to DSC02729.ARW.jpg (darktable-cli) 2024-07-18 15:06:56 INFO convert: converting DSC02728.ARW to DSC02728.ARW.jpg (darktable-cli) 2024-07-18 15:06:55 INFO convert: converting DSC02726.ARW to DSC02726.ARW.jpg (rawtherapee-cli) 2024-07-18 15:06:55 INFO convert: converting DSC02727.ARW to DSC02727.ARW.jpg (rawtherapee-cli) 2024-07-18 15:06:54 INFO convert: converting DSC02727.ARW to DSC02727.ARW.jpg (darktable-cli) 2024-07-18 15:06:54 INFO convert: converting DSC02726.ARW to DSC02726.ARW.jpg (darktable-cli) ``` For the affected RAW files, no JPG files are created in the sidecar directory, and subsequently no YML files either. Curiously, DigiKam (using LibRaw for RAW conversion) marks these RAW files as "TIFF" (but displays them correctly) while other RAW files from the same camera at different compression settings are marked as "ARW" as they should. Not sure if this is something that can or should be fixed within Photoprism (in the way that rawtherapee and darktable are utilised), or if this is simply a shortcoming of both of the utilised conversion tools... As this probably doesn't affect many users, and I myself don't intend on using this specific RAW compression setting, I am perfectly fine with this ending up as a "won't fix". I just thought you should know in case this is an easy fix, or in case there has been contemplation regarding changes of tools or settings for RAW conversion that this might factor into. I will provide a sample file and reference this issue.

deekerman

2026-02-20 01:07:03 -05:00

closed this issue
added the
bug

upstream-issue
labels

deekerman commented

2026-02-20 01:07:05 -05:00

Author

Owner

@lastzero commented on GitHub (Jul 18, 2024):

Many "custom" RAW formats are based on TIFF as not to reinvent the wheel. PhotoPrism itself does not directly try to open any raw images, so this probably is an upstream issue with Darktable and/or Rawtherapee.

@lastzero commented on GitHub (Jul 18, 2024): Many "custom" RAW formats are based on TIFF as not to reinvent the wheel. PhotoPrism itself does not directly try to open any raw images, so this probably is an upstream issue with Darktable and/or Rawtherapee.

deekerman commented

2026-02-20 01:07:05 -05:00

Author

Owner

@lastzero commented on GitHub (Jul 18, 2024):

Here is the related upstream issue:

https://github.com/darktable-org/darktable/issues/14659

@lastzero commented on GitHub (Jul 18, 2024): Here is the related upstream issue: - https://github.com/darktable-org/darktable/issues/14659

deekerman commented

2026-02-20 01:07:05 -05:00

Author

Owner

@dinoschachten commented on GitHub (Jul 18, 2024):

Yes, thanks! I searched around a bit and found that Darktable indeed explicitly does not support "Sony downsized lossless ARWs (“M” for full-frame, “S” for full-frame & APS-C)" (https://www.darktable.org/resources/camera-support/). Info for Rawtherapee is not as easy to find... would seem likely that both don't support it for the same reason. Sorry, I could have done my homework more thoroughly...

Unless you intend to integrate yet another conversion tool (LibRaw) I think this can be closed. ;) Perhaps it will be fixed in future releases of Darktable and/or Rawtherapee.

@dinoschachten commented on GitHub (Jul 18, 2024): Yes, thanks! I searched around a bit and found that Darktable indeed explicitly does not support "Sony downsized lossless ARWs (“M” for full-frame, “S” for full-frame & APS-C)" (https://www.darktable.org/resources/camera-support/). Info for Rawtherapee is not as easy to find... would seem likely that both don't support it for the same reason. Sorry, I could have done my homework more thoroughly... Unless you intend to integrate yet another conversion tool (LibRaw) I think this can be closed. ;) Perhaps it will be fixed in future releases of Darktable and/or Rawtherapee.

deekerman commented

2026-02-20 01:07:05 -05:00

Author

Owner

@lastzero commented on GitHub (Jul 18, 2024):

The related Rawtherapee issue can be found here:

https://github.com/Beep6581/RawTherapee/issues/7011

Based on this, it is indeed a problem with third-party software that can be tracked (and should be commented on) in the upstream repositories.

@lastzero commented on GitHub (Jul 18, 2024): The related Rawtherapee issue can be found here: - https://github.com/Beep6581/RawTherapee/issues/7011 Based on this, it is indeed a problem with third-party software that can be tracked (and should be commented on) in the upstream repositories.

deekerman commented

2026-02-20 01:07:06 -05:00

Author

Owner

@dinoschachten commented on GitHub (Jul 18, 2024):

Ah thanks! Even though these issues are slightly misleading: Lossless compression without downscaling is supported perfectly at this time (perhaps wasn't a couple of months back). It is really only the downsized lossless compressed ARWs that produce these issues.

@dinoschachten commented on GitHub (Jul 18, 2024): Ah thanks! Even though these issues are slightly misleading: Lossless compression without downscaling is supported perfectly at this time (perhaps wasn't a couple of months back). It is really only the _downsized_ lossless compressed ARWs that produce these issues.