This question is answered. Helpful answers available: 2. Correct answers available: 1.


Permlink Replies: 15 - Pages: 2 [ 1 2 | Next ] - Last Post: 9 Jan 24, 09:36 Last Post By: davidekholm Threads: [ Previous | Next ]
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Reprocessing of folder thumbnails
Posted: 2 Nov 23, 14:14
 
  Click to reply to this thread Reply
I saw in the release notes that the unnecessary reprocessing of folder thumbnails was fixed. This has been on my list for a long time. I don't think I ever reported it before, because it was occurring only in my massive "family photos" album. I've never had the time to start stripping it down so that I could provide a reasonably manageable, reproducible case. It was also fairly harmless, since it just meant that a handful of files were being recreated and uploaded again.

I had tried switching folder thumbnails, making the album, and then switching back, which sometimes would cure the problem for a folder, but it didn't work every time.

Alas, it's still there in jAlbum 33.1.

Perhaps if I knew what the source of the problem was/is, I might have more luck in helping to track it down.
davidekholm

Posts: 3,666
Registered: 18-Oct-2002
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 12:18   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
You're saying that you still see reprocessing of folder thumbnails even though no changes have been made?
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 15:06   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
Attachment folderthumbs.png (71.6 KB)
Yes, but it's fiendishly difficult to track down. Take a look at the screenshot from Windows Explorer, sorted by date. I haven't made any changes in those older "decade" or "year" folders in ages. And there are subfolders under some of those, so tracking down the ones that have been re-gened is messy.
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 15:19   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
I've stumbled on a more manageable project in which this is occurring. Just uploading some zips right now - I'll email you some details shortly.

ETA: Upload finished, email sent. Enjoy! ;)
davidekholm

Posts: 3,666
Registered: 18-Oct-2002
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 16:28   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Thanks. Unfortunately I can't still reproduce that problem.
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 16:49   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
And as I said in the email I just sent you, I can't make it stop.
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 3 Nov 23, 16:50   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
It might help if you could explain, in simple terms, what the core is looking at to determine whether it needs to reprocess a folder thumbnail or not.
davidekholm

Posts: 3,666
Registered: 18-Oct-2002
Re: Reprocessing of folder thumbnails
Posted: 4 Nov 23, 11:46   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
I agree. I'll study the code in detail and deliver a comment here.
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 8 Nov 23, 14:34   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
While it's not the problem I've been seeing, I have identified one condition that leads to the unnecessary regeneration of a folder thumbnail, and I think it's easily reproducible.

Create a new project, and create a single folder. Add a few images to the folder and make the album. Look at the time stamp on the output folder thumbnail. Now exclude one of the images in that folder - not the one being used for the folder thumbnail, but one of the others. Make the album, and I believe you will see that a new folder thumbnail has been generated.

I can't shake the feeling that this is somehow related to the "new folder thumbnail every time" error that I've been seeing, though in my case it's creating a new folder thumbnail for just a few old folders in the project, not for all of them, and no changes have been made to the older folders (and there's no new index.html for each of them, either).
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 3 Dec 23, 16:04   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
I'm finally zeroing in on this one.

First, if there has been any change in a folder, the folder thumbnail is regenerated, even if the change has nothing to do with the folder thumbnail. But that's one that I think we can all live with. After all, a change in the folder is probably producing a new index.html, and maybe new slide or thumbnail images. One more image is no big deal.

So why is it regenerating the folder thumbnail for a folder in which there has been no change? I know why, but I can't identify the underlying cause. In short, in some folders, for reasons unknown, albumfiles.txt is being "touched," even though nothing has happened in that folder at all. The contents of the file are exactly the same, but the file's modified date gets bumped. That, in turn, triggers the reprocessing of that folder's thumbnail.

Another observation: it seems to relate to whether or not the images have camera dates, and whether those dates have been written to albumfiles.txt. But I can't quite sort that one out.
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 7 Dec 23, 01:29   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
I'm going to mark this "answered," as I have figured out how to cure the problem. And the cure appears to be permanent.

There were two situations that gave rise to this "no change to the folder, but a new folder thumbnail" phenomenon.

The first involved fairly recent images, from the digital era. In one "problem" folder, I had 20 images, but in looking at albumfiles.txt, only the first 17 of them had camera dates. These were all taken with the same camera, on the same trip, just a few years ago. The images all had perfectly valid camera dates.

Why was jAlbum not picking these up? I have no idea. But I edited all the camera dates out of albumfiles.txt, and then reopened the project. I opened the folder for editing, and just looked through the images in edit mode, to give the core a chance to rewrite the camera dates to albumfiles.txt. Upon making the album, I got a new folder thumbnail, as expected. But that was the last time. Subsequent remakes were fine. And albumfiles.txt was now showing all the camera dates.

The second situation involved images from the pre-digital era. These, of course, really shouldn't have any metadata. These were scans of prints and slides. But various image processing apps had written all manner of spurious metadata to the files, including some completely fictitious "camera dates."

The solution was to edit the handful of "camera dates" out of albumfiles.txt, and then to put the source images through a little utility program I have that strips out all metadata - EXIF, IPTC, xmp. It leaves only basic file information, and the rudimentary "yes, this is a JPG" kind of information. Same result as in the first situation - one more new folder thumbnail, but then no further recreations.

My guess is that somewhere along the line, some stray non-printing characters found their way into albumfiles.txt. Each album build caused the core to try to "fix" the file, but unsuccessfully. So, the file was "new" every time, and a new folder thumbnail got generated every time.

If David wishes to pursue this further, I do have one "preserved" project that shows the bug. But it's tough to experiment with, because if you do anything that prompts the core to write out the camera dates again, the problem goes away.
davidekholm

Posts: 3,666
Registered: 18-Oct-2002
Re: Reprocessing of folder thumbnails
Posted: 7 Dec 23, 15:52   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Hi. Please zip up that demo project. Hopefully I can reproduce
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 7 Dec 23, 16:25   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
Check your email. :)
JeffTucker

Posts: 7,936
Registered: 31-Jan-2006
Re: Reprocessing of folder thumbnails
Posted: 8 Dec 23, 22:13   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
David believes he's cracked this problem, and in my testing, it seems to work just fine.

It cures the problem of a folder thumbnail being reprocessed on every album build, even if nothing in that folder has changed.

But it also takes care of the lesser problem, in which any change in the folder would trigger a new folder thumbnail, even if the change had nothing to do with it. Now you get a new folder thumbnail only if you've changed something about it - the folder thumbnail image bounds, the choice of a folder thumbnail, or the substitution of an edited version of the same image.

If anyone else has seen this problem, please try the new jAlbum core. Tools, External Tools, jAlbum core update. You should get version 33.3.1 upon relaunch.
davidekholm

Posts: 3,666
Registered: 18-Oct-2002
Re: Reprocessing of folder thumbnails
Posted: 9 Dec 23, 14:27   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Thanks for assisting with testing Jeff. I'm now pushing out this fix to owners of v33.3. Those who download jAlbum now will get v33.3.1.
Legend
Forum admins
Helpful Answer
Correct Answer

Point your RSS reader here for a feed of the latest messages in all forums