This question is not answered. Helpful answers available: 2. Correct answers available: 1.


Permlink Replies: 15 - Pages: 2 [ 1 2 | Next ] - Last Post: 6 Mar 24, 16:02 Last Post By: davidekholm Threads: [ Previous | Next ]
allenhuffman

Posts: 51
Registered: 20-Mar-2008
HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 05:09
 
  Click to reply to this thread Reply
I have huge photo galleries with digital photos going back to my first digital camera in 1996. I have had to break them up in to standalone galleries on different web accounts since they exceed some file count limit on my server ;-) (inodes, if you are in to that stuff...)

I started using Mirror awhile back since it solved the issue of writing hundreds of thousands of files to my master photo structure.

But, if I already made a "Universal2023" folder, and then later add 3000 new photos to it, Album does not add them. I believe someone in this forum told me it can't and I need to go back to using Link instead.

I am curious if there is a "best practice." I read the web help page about Link versus Mirror, it sounds like the only way to get "safe" (where if I delete in the gallery, it doesn't delete my master image) is to let it COPY everything over.

Which is fine, until you have 150,000 photos ;-)

Any tips on how others handle large galleries would be greatly appreciated.
davidekholm

Posts: 3,439
Registered: 18-Oct-2002
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 12:46   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
You CAN let jAlbum copy the full folder structure, but use hard links in the copies. That way the copies don't consume any extra disk space (apart from one inode for each "copy" pointing to the same data). See Preferences->Use hard links.

If you're concerned that the album structure should, at all times mirror the structure on disk, then I recommend the "Use folder" option, where jAlbum is pointed to your original image structure. Yes, this has the side effect that if you delete an image within jAlbum, then it's physically deleted from your disk as well. To reduce such consequences, use backups.

I'm exploring whether to add a "Refresh" option to the "Mirror content" mechanism so you can force jAlbum to recreate the a mirrored folder structure by means of links at any given time. To support this, jAlbum would only need to keep track of the target folder of the root of such a mirrored tree.
JeffTucker

Posts: 8,178
Registered: 31-Jan-2006
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 15:23   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
I don't think this is even remotely complicated enough. Copy, Link, Mirror, Use Folders, Hard Links, plus various permutations and combinations of them - it's all just too simple, and too easy to explain to a user, especially when it comes to the side effects (desirable or otherwise) of each.

The means of choosing these options are also too basic - preference settings, responding to a prompt when adding, plus a marvelous collection of keyboard shortcuts, like "Click and drag while holding down CTRL and Scroll Lock, all while singing at least two verses of Land of Hope and Glory."

We need more options! I'm just glad I'm not the one who has to explain them to anyone else.
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 16:16   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
davidekholm wrote:
You CAN let jAlbum copy the full folder structure, but use hard links in the copies. That way the copies don't consume any extra disk space (apart from one inode for each "copy" pointing to the same data). See Preferences->Use hard links.

If you're concerned that the album structure should, at all times mirror the structure on disk, then I recommend the "Use folder" option, where jAlbum is pointed to your original image structure. Yes, this has the side effect that if you delete an image within jAlbum, then it's physically deleted from your disk as well. To reduce such consequences, use backups.

I'm exploring whether to add a "Refresh" option to the "Mirror content" mechanism so you can force jAlbum to recreate the a mirrored folder structure by means of links at any given time. To support this, jAlbum would only need to keep track of the target folder of the root of such a mirrored tree.


Some form of “Refresh” would be ideal. My solution has been to delete all the subfolders from 2023, and re-add them. This negates the “NEW” marker I have in Photoblogger, since not all the sub-folders are updated. In an ideal world, I might have:

UniversalStudios2023
—MinionLand
—NewYork
—FifteenDollarBeerCart

If I make a second visit in 2023, and add new photos of the FifteenDollarBeerCart, it would be nice if marked just that folder as “NEW”. But, this “NEW” is also new to me, and I don’t know if it means “new since the last time the album was built” or “added in the past X days.” If it is based on “past X days” I suppose it wouldn’t matter.

Another challenge is after several visits, I may find I now have enough photos of something for it to move to its own sub-folder. As I am adding new photos, I might go through them and make new subfolders and moving things there. But Jalbum (with mirror) is locked in time, and those changes - moved photos, new folder - do not show up.

Some manner of “Refresh all the items in the top of this JAlbum, and their subfolders” would suffice — if technically easy to do.

When I first shared photos in 1996, I put them on an FTP server on my PC and would dial in to the ISP at night and let folks connect to my machine. Over the years, I have had several different tools for the album - from DOS tools that made an HTML thumbnail page of photos in a directory, then a different tool to link all the HTML links in to a page, to various things I wrote myself. When Mac OS X was new, a company had a super cool photo gallery, but eventually my folders were too large and it broke. Jalbum has outlasted them all, and any issues found over the years were all resolved. Such a great tool.

It just takes a different approach to all the ones I used. They would just scan an images folder, and generate thumbnails and HTML based on it. No need to copy anything, unless they had an option to “include full size” in which case that would get copied over to the HTML gallery. That makes sense.

I think I need to get over my confusion with mirror, link, use folder (new one to me), etc.
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 16:18   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
JeffTucker wrote:
We need more options! I'm just glad I'm not the one who has to explain them to anyone else.

:-) I am thinking when I first used Jalbum, it had far fewer choices. And everyone knows, choice is good!

My projects always seem to break tools — photo albums from a birthday party, easy. 5000 photos from a Disneyland trip, crash. Imported video organizer from a dozen Christmas tapes, good. From 300 Digital8 tapes? Crash. Jalbum chugs right along, though I always seem to get it in a “Not Responding” state and have to force-quit it after 10 minutes or so of it appearing locked up. BUT, it’s better than anything else I’ve ever used.
JeffTucker

Posts: 8,178
Registered: 31-Jan-2006
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 16:45   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
Perhaps you should start thinking about curating your material.

Even in the film era, the best photographer wasn't the one who cranked out the most prints - the best photographer was the one who selected the choicest material, and tossed the rest into the bin. In the digital era, that's become even more true.
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 17:02   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
JeffTucker wrote:
Perhaps you should start thinking about curating your material.

Even in the film era, the best photographer wasn't the one who cranked out the most prints - the best photographer was the one who selected the choicest material, and tossed the rest into the bin. In the digital era, that's become even more true.


I’m not that type of a photographer. I’m an archivist. And even if I said “I’ll just post 100 photos from this trip,” after doing it for 30 years, you still have a ton ;-)

I am not a photographer. I know little about cameras. But I’ve had my photos used on TV (most recently in an episode of Pawn Stars), on brochures, in newspapers, and some “borrowed without asking” in YouTube videos and such.

I would go up and down the “main street” of a local amusement park, taking photos of each building and storefront and all the little details. When they had a fire, which wiped out one side of their main street, they used my photos as reference for the insurance claim and for rebuilding. It’s that kind of stuff.

And frankly, I wouldn’t have time to go through all my photos to decide which ones to post.

“A crappy photo is better than no photo” and “Quantity, not quality” are my slogans. I have the largest archive of organized Disney/theme park photos on the Internet, though I expect there are blogs that have more — I see 100 photos posted in an article, several times a week, from some of them, but try to find something you know you say there, sometime in the past.
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 17:03   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
JeffTucker wrote:
Perhaps you should start thinking about curating your material.

Heh, I should have just said “isn’t that kinda like telling someone who brings their car in to the shop they should just drive it less?” ;-P
JeffTucker

Posts: 8,178
Registered: 31-Jan-2006
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 17:16   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
allenhuffman wrote:
JeffTucker wrote:
Perhaps you should start thinking about curating your material.

Heh, I should have just said “isn’t that kinda like telling someone who brings their car in to the shop they should just drive it less?” ;-P


If the guy has been driving nonstop around the same block for two months, that's probably good advice. ;)

(Check your private messages in here, for a chuckle.)
davidekholm

Posts: 3,439
Registered: 18-Oct-2002
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 17:35   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
Hi Allen, the more I think about it, the "Use folder" option should be what you need. See https://jalbum.net/help/en/Managing_images_with_jAlbum
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 18:06   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
davidekholm wrote:
Hi Allen, the more I think about it, the "Use folder" option should be what you need. See https://jalbum.net/help/en/Managing_images_with_jAlbum

I read this last night, and was unsure — but reading after these posts, I think it implies I could use this to actually SORT my photos. Right now, I use a Mac program called Graphics Converter.

“ Instead of copying or linking files and folders to jAlbum, you can have jAlbum work with the folder you drop onto it. If you now move images and folders around within jAlbum, so does the physical files in that folder too. If you delete blurry or bad images within jAlbum, the real originals are deleted from the hard disk too (put in the recycle bin). If you add, move or delete images outside of jAlbum, these changes are picked up by jAlbum (may require you to press F5 or F5+Alt/Opt/SHIFT though). You never get any broken links.”

I will give this a try! Thanks! I just have to know that if I do what I’ve been used to doing - deleting a whole folder so I can regenerate - that would now be “not desirable” ;-)
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 18:09   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
Question — the original way I did it put tons of control files in my photo gallery. I also found this caused problems if I wanted to take just some of my photos and use them in a different gallery. For example, I might have a massive “Disneyland” gallery with photos going back to 1996, but decide I want to publish a special “Disneyland’s 50th Anniversary” gallery with just those folders. It would use all the settings from the big gallery, since those were the .jalbum (or whatever files) from that.

I also have lost so many photos of the year due to file system corruption — I had everything backed up to TWO different DROBOS (today, a Synology NAS with dual drive redundancy) and that’s great for hard drive failures, but doesn’t do a darned thing about a file system getting screwed up. I could make a disk image of my library, and make it read-only to prevent anything from getting screwed up, but that original jalbum wouldn’t like that.
davidekholm

Posts: 3,439
Registered: 18-Oct-2002
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 3 Jan 24, 18:36   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
Well, the "downside" or the "Use folder" options is that if you delete stuff from within jAlbum, they get deleted from disk (actually moved to the recycle bin first)
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 4 Mar 24, 03:05   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
davidekholm wrote:
Well, the "downside" or the "Use folder" options is that if you delete stuff from within jAlbum, they get deleted from disk (actually moved to the recycle bin first)

That will be the first thing that bites me, after a decade+ of "deleting" things out of JAlbum having no effect on my master files.

I have another batch of 2500 photos to add from a recent trip, so I'll be going through these posts and doing some experimenting.

And my photos live off-site, on a NAS with dual drive redundancy, and three pocket hard drives. I've had too many hard drives "just die" over the years ;-)
allenhuffman

Posts: 51
Registered: 20-Mar-2008
Re: HUGE photo galleries that get updated throughout the year? Link/mirror?
Posted: 6 Mar 24, 03:47   in response to: allenhuffman in response to: allenhuffman
 
  Click to reply to this thread Reply
https://jalbum.net/help/en/Managing_images_with_jAlbum:
If you like this way of working, begin a project by CTRL-dropping an image folder onto jAlbum’s empty project (ALT-dropping on Mac).

I have no ALT key on my Mac. I deleted all the folders out of an existing Album I have (with all my PhotoBlogger settings customized that I want to keep), and I tried dragging in with Control+, Option+ (both do COPY) and Command+ (mirror/link).

Is there a menu to add files using Folder? I am going to give it a try on one of my smaller galleries -- only 211 GB of images.
Legend
Forum admins
Helpful Answer
Correct Answer

Point your RSS reader here for a feed of the latest messages in all forums