This question is not answered. Helpful answers available: 2. Correct answers available: 1.


Permlink Replies: 67 - Pages: 5 [ 1 2 3 4 5 | Next ] - Last Post: 4 Dec 23, 12:11 Last Post By: davidekholm Threads: [ Previous | Next ]
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
ANOTHER all images rebuilt upon upload thread.
Posted: 18 Apr 23, 22:37
 
  Click to reply to this thread Reply
NOTE: SOLUTION on Page FIVE after much trial and error.

I've read the previous. This is SO frustrating.

I have 15,000 images with over 15GB of files. Once I do something stupid (like UPDATE jalbum to a newer version), it starts all over. 4-5 hours of uploading....

...until it his a snag at 90%. "Sorry. Operation failed. Abort" It gets stuck on a file, or something.

When it works it works well. It ONLY updates the added files. But at this point I can't get it to reestablish a base.

I've been using JAlbum for 10 years+.

http://www.knifegallery.com/index.html

Yes, I have made sure the checkbox in settings says "only update new files" or something to that effect. I do not have any create ZIP files checked.

My problem is I have SO MANY images it is exhausting to completely rebuild, and when it STOPS at the 90% mark, we have to try again. It's been five attempts over two days. I have VERY reliable cable internet.

Tell me where to begin.... Sorry for the obvious frustration, but I can't seem to get past this.

Edited by: SharpByCoop on 18 Apr 2023, 22:44

I tend to edit and add files monthly as they get finished. It's a service to my clients they can search and always see their work for posterity.

Edited by: SharpByCoop on 3 Dec 2023, 23:32
JeffTucker

Posts: 8,133
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 18 Apr 23, 22:58   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
Three separate problems, here.

First, the easy one. You should not be telling jAlbum to process only updated subdirectories. With a skin like Tiger, this will produce an album in which things like the search function are broken. And if you've switched to a newer version of jAlbum or Tiger, the breakage in the album could be much worse. It's a long story, but please just trust me on this one.

Having that set correctly will, of course, generate a new index.html file for each folder, but those are small files, quickly uploaded. Just not a big deal. You will also get new JSON files (used for searching and other things), but those won't be massive, either. Not tiny - in your existing album, the deep-data.json file, for example, is just shy of 6MB. But we're talking megabytes here, not gigabytes.

The second problem, more mysterious, is why the core is generating newly-scaled images. Is that really what's happening? When you build the album, is it taking an ungodly long time? If you open the output directory and look at the file information in any of the slide folders, are you seeing new file timestamps? You're not doing a Force Remake, are you?

The third problem is the failure of the upload. David may be in touch - he might need access to your server to experiment. It's one of those areas in which there's not much useful error information in the app itself.
AndreWolff

Posts: 1,288
Registered: 14-Dec-2007
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 19 Apr 23, 14:27   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
SharpByCoop wrote:
I've read the previous. This is SO frustrating.

I have 15,000 images with over 15GB of files. Once I do something stupid (like UPDATE jalbum to a newer version), it starts all over. 4-5 hours of uploading..

I have seen that too, see https://jalbum.net/forum/thread.jspa?threadID=58798
davidekholm

Posts: 3,471
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 19 Apr 23, 15:43   in response to: AndreWolff in response to: AndreWolff
 
  Click to reply to this thread Reply
As I've said before: I am naturally 100% motivated to fix a bug, if this is indeed a bug. Try to reproduce it!
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 19 Apr 23, 17:24   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Hi Jeff<

Thanks for your prompt and most knowledgable tips.

ME: Mac Studio with M1 chip. JAlbum 30.2 with pro license.

UPDATE: Finally after many attempts last night the process went through completely without fail. My website reflects what my JAlbum program has created.

1. I am afraid to touch it. What I want is to add some new files, or move a few around, and it ONLY changes them. As it should. As it used to.

2. It will rebuild quickly when I do such. Like in less than a minute. Nice.

3. When it uploads, that's when the trouble started. It stopped on a quick run through for some hangup glitch. So I cancelled, and THEN it began anew needing to upload 15.8gb of files.

That's the rub. In that lonnnng time ANYTHING can happen, and it consistently stopped on a file (Lost internet? I dunnno.)

4. You are savvy to ask: The previous slides on my computer are files CREATED earlier. The timestamp was not all yesterday. The latest ones were. Why they ALL needed re-uploading is beyond me.

5. Search is working as I type. MUCH needed. Recommend which setting I should have? You mentioned NOT processing only updated? I took this as FORCING the program to do what it's been doing: 15gb upload every update. If I uncheck that, will it only do a minimal amount of work? Please advise.

See screenshots of some settings. I appreciate your expertise.

Jim

Edited by: SharpByCoop on 19 Apr 2023, 17:27

Just before it completed yesterday I took this important screen grab. It shows it uploading or extracting a ZIP file. Huh?
JeffTucker

Posts: 8,133
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 19 Apr 23, 18:07   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
SharpByCoop wrote:
1. I am afraid to touch it. What I want is to add some new files, or move a few around, and it ONLY changes them. As it should. As it used to.

And as it always does, for me at least.

2. It will rebuild quickly when I do such. Like in less than a minute. Nice.

That's been my experience.

3. When it uploads, that's when the trouble started. It stopped on a quick run through for some hangup glitch. So I cancelled, and THEN it began anew needing to upload 15.8gb of files.

I think I know what's happening here. You've got a bad internet connection. jAlbum can compensate for that, but only up to a point. If it loses the connection entirely, it can no longer rely on the manifest file to tell it what needs to be uploaded. Then it has to drop back to doing a more traditional upload routine - compare each file on the server to the file on the PC. If the PC version is newer, upload it. Otherwise, skip it. So when it's telling you that it's uploading 15GB, that's a "worst case" scenario - it won't really know until it actually does the uploading.

I recently started having horrendous uploading problems. Long story short - the Ethernet port on my PC was bad. Downloads were fine, but uploads were a disaster.

Try doing some speed tests - install this app: https://www.speedtest.net/apps/desktop

4. The previous slides on my computer are files CREATED earlier. The timestamp was not all yesterday. The latest ones were. Why they ALL needed re-uploading is beyond me.

Those timestamps tell me that jAlbum is not producing all new slide images. It's not actually uploading all of them. So the smart "make album" is working as intended.

5. Search is working as I type. MUCH needed. Recommend which setting I should have? You mentioned NOT processing only updated? I took this as FORCING the program to do what it's been doing: 15gb upload every update.

No. The only thing that would trigger the production of all new scaled images would be a Force remake. Please just uncheck Process only updated subdirectories. That is creating album errors that you may not even find initially. But they're there. As I said above, that will create only new index.html files for each directory/folder - not a big deal.

Just before it completed yesterday I took this important screen grab. It shows it uploading or extracting a ZIP file. Huh?

At some stage of the game, you must have told Tiger to offer zip files of the images for downloading. It appears that you've turned that off, but the files are still out there. Open up the output directory of the project, and find and delete any zip files you find. Finder should be able to locate them quickly. The skin doesn't need them for anything.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 19 Apr 23, 19:15   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Jeff (and others)

Thank you again. I will make these changes, and then report back with my update.

MUCH appreciation.

Jim
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 23 Apr 23, 18:52   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
Pardon the four day delay. I've been busy. (aren't we ALL!)

Followup: I added a handful of items into my gallery, then UNCHECKED the box 'Process only updated subdirectories' As mentioned above.

I rebuilt the gallery; it took a bit longer this time, like 2.5 minutes, but that's a drop in the bucket.

Time to UPLOAD.... fingers crossed.

Success! It only processed the new files, reviewed the rest and it was done in a couple of minutes. As it should be.

Of course that's the way it USED to be too, until I began this thread. I was flummoxed.

Thanks for being responsive to my needs. My site: 12,500 images ,15.8 GB of searchable uploads and it's back to behaving. Jalbum FTW.

Jim Cooper
davidekholm

Posts: 3,471
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 23 Apr 23, 20:56   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
Good that it works again Jim. Can you confirm if this upload problem was preceded by jAlbum reprocessing all images or not? I.e, did you encounter a slow "Make album" operation prior to jAlbum uploading all images again?

(I'm trying to isolate, in case this IS a bug, whether jAlbum actually reprocesses all images accidentally or if it "just" re-uploads all images accidentally)
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 24 Apr 23, 02:09   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
David, at this point, I can't recall. I THINK it built it OK, and then in uploading it hit a stopping point. (Hung up on a file, if I recall. )

So then I X-out of the upload and try again. And THEN instead of going only through the new images, it begins the ENTIRE rebuild (?) Process. 5 hours. It didn't like to do this a second time.

And as was pointed out it is not even remaking every file? My HOME jalbum output directory had files made months ago. Huh?

So, maybe it was an internet glitch. I will pay closer attention if/when it happens again. This is NOT infrequent. But, I will note exactly what the sequence is.

I appreciate your program, the Turtle skin, and this forum for help. Believe it.

Jim
JeffTucker

Posts: 8,133
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 24 Apr 23, 02:12   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
SharpByCoop wrote:
I appreciate your program, the Turtle skin, and this forum for help. Believe it.

You had me there for a second. I thought, "Geez, I hope he's not still using Turtle!" But I see that you have, in fact, moved to Tiger. :)
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 24 Apr 23, 20:47   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Oops! Yes, I USED to have Turtle, and something even before that.

Tiger it IS. Really a great interface for me. Nicely structured.

Thank you Jeff and David.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 24 Apr 23, 20:48   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
We worked it out and I got some more constructive tips.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 25 Apr 23, 14:29   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
Well... Not so fast. It's BAAAACK.

I had to change ONE FILE (a misspelled one for a client.)

I removed one file, replaced one file. Hit build and it did so in just over 2 mins.

Then I uploaded it. It has a small progress bar, and it went all the way across as normal in about one or two mins....

Then it said "Writing manifest" and THEN began the whole upload process again, progress bar at the beginninng. 15.85gb of uploads. I ABORTED.

The website had loaded with my channges. Hmmmmm.

So this morning I simply repositioned ONE file in my opening gallery (Featured). I rebuilt it 2+ mins., then UPLOAD:

It began the LENGTHY rebuild all. No short progress bar. I aborted.

Now the 'Featured Gallery' is broken thumb.

Sigh. So it is back to the 5 hour rebuild just to reposition one file. (See screenshot)

Internet is fast. I dunno.

Edited by: SharpByCoop on 25 Apr 2023, 14:30
http://www.knifegallery.com/index.html
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 25 Apr 23, 23:26   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
I let it run. Took four hours.

It all is how I wish out there but see the final screenshot of how it ended.

I don't trust it. I'm going to leave it alone for now. I'm away on business for then next ten days from my home computer, so I can't make changes anyway.

Sorry to report frustrating news, who knows.

Jim
Legend
Forum admins
Helpful Answer
Correct Answer

Point your RSS reader here for a feed of the latest messages in all forums