This question is not answered. Helpful answers available: 2. Correct answers available: 1.


Permlink Replies: 67 - Pages: 5 [ Previous | 1 2 3 4 5 | Next ] - Last Post: 4 Dec 23, 12:11 Last Post By: davidekholm
JeffTucker

Posts: 8,091
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 25 Apr 23, 23:30   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
David: could a damaged manifest file trigger something like this? It might not actually be uploading everything again, but the process of checking files one at a time can be pretty pokey.

SharpByCoop: connect to your server with something like FileZilla, or go into the cPanel File Manager on your hosting account, and take a look at the timestamps on some of the older, unchanged slide images. Are they actually new file dates?
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 26 Apr 23, 04:44   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Hi Jeff,

Thanks for asking. I used a program called 'Fetch' to get into the server and look....

EVERYTHING is new. All Slides time stamps are from today. So it IS signalling to rebuild them.

Hmmmm......
davidekholm

Posts: 3,446
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 26 Apr 23, 15:33   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
I AM paying close attention to this issue, but it's frustrating that it's hard to reproduce. Thank you for your patience. ARE YOU SURE you noticed jAlbum performing a lenghty "Make All" operation when you simply hit the "Make album" button?

@Jeff: If, for some reason, the old manifest file isn't updated with a new one and not deleted either, then jAlbum will re-upload all updated files again, but I can't see how this can happen as jAlbum deletes the old manifest file prior to uploading the changes. It's good if the user can check the date stamp of the manifest file after an upload. It should have the most recent "last modified" date.
JeffTucker

Posts: 8,091
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 26 Apr 23, 15:45   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
davidekholm wrote:
ARE YOU SURE you noticed jAlbum performing a lenghty "Make All" operation when you simply hit the "Make album" button?

I have doubts about that, as well. Uploading is just a file-copying operation. I can't imagine how it could ever trigger another Make album operation of any sort.

SharpByCoop, please take a look at the timestamps on the slide images in the output directory on your PC. Do they all have new dates? If not, there's no Force remake operation happening here - that would produce all new file dates.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 27 Apr 23, 22:21   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
Thank you all for helping.

David, here's what I wrote: "I removed one file, replaced one file. Hit build and it did so in just over 2 mins."

So it does NOT make a new album. That's good, right? two mins is easy.

Still when I UPLOAD, it goes file by file for hours. This is my dilemma.

On my home PC the Output Directory files are time-stamped correct and go back from this week to Dec 2022 when I actually did a full (force) rebuild.

I'm away on biz. If you have settings you think I can make, please suggest. I can do so from home when I return.

Why it's flagging to upload individually is beyond me. My Fetch program dated them each at the time of upload on the server, even through the Output Directory on my PC is earlier. Hmmmm.

It must be me. But it's erratic; one day it works and then it doesn't.

Thank you.
JeffTucker

Posts: 8,091
Registered: 31-Jan-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 27 Apr 23, 22:26   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
At least it's good that we're narrowing it down. Based on the evidence, it's purely an uploading problem, not an album generation problem.

On the other hand, uploading problems are a lot tougher to debug without an extensive software toolkit. I'm out of bright ideas (or did I have any? ), so I'll have to leave it in David's hands.
davidekholm

Posts: 3,446
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 30 Apr 23, 20:00   in response to: JeffTucker in response to: JeffTucker
 
  Click to reply to this thread Reply
I'm REALLY motivated to fixing any such (seemingly) upload bug, but I need a way to reproduce it. See if you can trigger this problem at will. That's a great start.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 1 May 23, 16:34   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
Thank you David and Jeff.

I will return in six days. It ENDED on a good note and everything was uploaded as I directed on my PC Program.

I'll do this:
1. Build Album (no changes) Upload album. All doing nothing more?

Depending on this outcome, I will them add or change some files. I have updates to include.

2. Build rebuilt album. Upload album.

It will take me until May6 to get to this. I am 4000km away.... :)

Jim
davidekholm

Posts: 3,446
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 2 May 23, 17:06   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
We'll stay tuned for your results
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 8 May 23, 02:43   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
I'm back.

I added a few files, rearranged others, and then rebuilt...

I set up a video camera to watch.

Constructed the album in just over 2 mins. Perfect.

Then I clicked UPLOAD....

ALL OK! It did so in another two mins ONLY. Went right to the finished album online, as it usually does, when successful.

So, there is SOME glitch on my end. Internet? If it has a hiccup in either process, does that trigger what I have encountered? Hmmm.

So we can't fix what isn't broken. But that's where I was a page before! HA!

Wish me well. In the mean time it's working as constructed, and I'm pleased.

I SO appreciate your attentiveness.

Thanks Jeff and David.
davidekholm

Posts: 3,446
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 8 May 23, 10:56   in response to: SharpByCoop in response to: SharpByCoop
 
  Click to reply to this thread Reply
Thanks for the update. Perhaps some IO issue can cause this, but I've tried to design the uploader to account for IO problems. There is for instance the scenario where an IO problem prevents jAlbum from writing an updated manifest file at the end. In this case, the uploaded album is left without a manifest file. This should not cause a full re-upload, but instead trigger jAlbum to compare each file manually in order to figure out what files to upload.

Perhaps the extreme case of a half-written or empty manifest file can cause this problem. I have to investigate that further...
jimbella

Posts: 2
Registered: 29-Sep-2014
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 8 May 23, 11:36   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
 I have to investigate that further...

This thread is unfortunately very familiar... 15000 images, 2.5GB. I always just click "Make and upload in the background" - and from time to time the tool decides everything needs to be uploaded again, but it takes several attempts to do so. After a few hundred MB it just stops doing anything, until all of a sudden on one of my attempts it gets through it and from then on I'm good for a while. Why it sometimes decides everything is new all of a sudden - beats me. So if you need another case for your investigation, feel free to contact me (sorry, can't put the URL public).
Currently I have another 4.5 hours of uploading ahead of me, so I better not let this laptop fall asleep...
davidekholm

Posts: 3,446
Registered: 18-Oct-2002
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 8 May 23, 15:46   in response to: jimbella in response to: jimbella
 
  Click to reply to this thread Reply
I actually have a test for you guys: If you notice that jAlbum embarks on yet another unneeded upload of all files, then follow these instructions and report the result to me:
  • Immediately abort the lengthy upload
  • Open Tools->Upload/Manage and connect to your server
  • Hit the "Advanced" button in the toolbar to also reveal files
  • Locate the "manifest.jmf" file under the target folder
  • Download it
  • Delete it from the server
  • Close the upload window and reattempt the upload. It should now, after some initial file comparison (could take minutes) ONLY upload new and changed files. Does it?

If it works now, please attach the "manifest.jmf" file you downloaded. If this didn't help at all, or if you couldn't find the "manifest.jmf" file, let me know as well.
SharpByCoop

Posts: 35
Registered: 2-Sep-2006
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 8 May 23, 15:51   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
The LAST thing I had seen in the past when it began to start anew was something referring to the 'manifest file'...

It actually scrolled across the upload timeline quickly, announced THAT, and then began anew in in a NEW timeline = 4 hours.

Id point my finger at the manifest file rewrite. Thanks for paying attention.

Jim

Edit: Just saw your appended post above. Great tip. I will do such. That's a good method to pinpoint the glitch there IF that's the problem. Thank you.

Edited by: SharpByCoop on 8 May 2023, 15:52
jimbella

Posts: 2
Registered: 29-Sep-2014
Re: ANOTHER all images rebuilt upon upload thread.
Posted: 9 May 23, 07:41   in response to: davidekholm in response to: davidekholm
 
  Click to reply to this thread Reply
Close the upload window and reattempt the upload. It should now, after some initial file comparison
(could take minutes) ONLY upload new and changed files. Does it?

I'm afraid not, attempt umpteen to upload 2.47 GB...
Legend
Forum admins
Helpful Answer
Correct Answer

Point your RSS reader here for a feed of the latest messages in all forums