This question is not answered. Helpful answers available: 2. Correct answers available: 1.

Reply to this Thread Reply to this Thread Search Forum Search Forum Back to Thread List Back to Thread List

Permlink Replies: 11 - Pages: 1 - Last Post: 1 Feb 24, 14:41 Last Post By: davidekholm Threads: [ Previous | Next ]
jfrayfield

Posts: 1
Registered: 20-Mar-2022
Album Uploads 'Hang' (stop working)
Posted: 20 Mar 22, 22:28 		 
  Click to reply to this thread Reply
I'm having a problem with uploading albums to a website.

I'm running jAlbum 23.2.4.

To upload to this web server requires FTP Over Explicit TLS/SSL.

When I try to upload an album to a website, the connection is established just fine.

The upload will usually begin and run for a while.

But, part way through the upload, it appears to stop uploading, as filename shown in the upload window is "data.json" and it never changes. The time left to upload just keeps going up (instead of down).

If I use Filezilla and upload all of the files in the album that I want to upload, everything works fine. So, at least I have a 'backup' way of uploading albums.

What is jAlbum doing with the file (or folder?) "data.json"? It appears that this where the problem lies, as if it's trying to write to a file and can't accomplish this, and then just keeps trying on and on without failing with an error.

John Rayfield, Jr.
JeffTucker

Posts: 8,245
Registered: 31-Jan-2006
Re: Album Uploads 'Hang' (stop working)
Posted: 20 Mar 22, 23:00   in response to: jfrayfield in response to: jfrayfield 		 
  Click to reply to this thread Reply
Not sure why your upload would be hanging - we'll have to wait for David to check in.

But does your web host support SFTP? I've found that to be much more robust than any of the other secure protocols.
davidekholm

Posts: 3,492
Registered: 18-Oct-2002
Re: Album Uploads 'Hang' (stop working)
Posted: 21 Mar 22, 14:54   in response to: jfrayfield in response to: jfrayfield 		 
  Click to reply to this thread Reply
Hi. Please contact me directly at david_at_jalbum_dot_net and provide me with your connection details so I can see if I can reproduce this. jAlbum should be able to upload anything that FileZilla can.
wolf-skate

Posts: 47
Registered: 1-Sep-2009
Re: Album Uploads 'Hang' (stop working)
Posted: 29 Jan 24, 17:02   in response to: jfrayfield in response to: jfrayfield 		 
  Click to reply to this thread Reply
Hi
this thread title is closest to what I experience now:

JA34 (also now tried 34.1, no change)
W10
set to SFTP
Turtle (yes know it old/out of service but running flawless until now - and still is on the local updated album..and can't see upload should care what skin)

Have a large album (2,4Gb) which I update few time a month. Been running w/o problems at least last year or more. However, Yesterday want to update w little new folder (few 10s pix) -> build -> preview fine -> upload (and here just what I remember) :spinning wheel counting the existing album size, I then hit ok..and 'am off' to see some streaming (so browser hides the JA)..anyway after a watching movie for a while, get puzzled I do not get the usual feed/new window with my album popping up in my browser?
->check JA, the upload (blue progress bar?) it just sits a point and does not move -> I stop/ cancel
try launch upload again = now the counting (spinning wheel) of existing album on server, get stuck at random positions (as low as 10Mb and as high as just 2Gb), try more than a dozen times hoping there would be some progressive picture in the counting, but is not

so never gets to the actual upload point again, where I get prompted for OK. Looking on the server w FileZIlla, lifeboat file is there (28/1 2024), so must be the one from 1st attempt yesterday..and the new folder is there, but without content. So an incomplete upload

no error messages, nothing

so how to resume upload w/o forcing a total new upload of all the album?
davidekholm

Posts: 3,492
Registered: 18-Oct-2002
Re: Album Uploads 'Hang' (stop working)
Posted: 29 Jan 24, 18:34   in response to: wolf-skate in response to: wolf-skate 		 
  Click to reply to this thread Reply
With the lifeboat file in place, the upload should only consider new and changed files after it was written. Without it, jAlbum does a more lengthy remote- and local file comparison which should result in only uploading new and changed files too.

If jAlbum gets stuck during the upload process, but without errors, ensure you have the system console window open before you upload, then when it gets stuck, hit the "dump threads" button in the top-right corner and pass med the generated file for inspection.
wolf-skate

Posts: 47
Registered: 1-Sep-2009
Re: Album Uploads 'Hang' (stop working)
Posted: 29 Jan 24, 21:53   in response to: davidekholm in response to: davidekholm 		 
  Click to reply to this thread Reply
Attachment Screen Shot 01-29-24 at 09.42 PM.PNG (39.2 KB)
Attachment Screen Shot 01-29-24 at 09.37 PM.PNG (18.2 KB)
Attachment thread-dump.txt (42.8 KB)
edit : just included the thread dump file

lifeboat is there 1,3Mb from yesterday (have not rebuilt album as local copy is working just fine). Se two screen shot..one FZ from the server other from file list of local copy

now try upload w system console:dump below..the strange thing is the last 3 lines..the 3rd (very last, appeared when the album size counting halted = says reconnecting but never does so) ftp4j ??..but I have set FTPES (as for 'ages' my ISP demands this explicit and has been working till now/however 'ancient times' there was problems as well..did remember wrong saying SFTP). Entering the server (wrt album location etc) seems OK w FTPES/judging by JA server content listing..it is first when trying upload now the funny stuff begins

Skin loading: 0,366s
Skin loading: 0,526s
java.net.SocketTimeoutException: Read timed out
at java.base/sun.nio.ch.NioSocketImpl.timedRead(Unknown Source)
at java.base/sun.nio.ch.NioSocketImpl.implRead(Unknown Source)
at java.base/sun.nio.ch.NioSocketImpl.read(Unknown Source)
at java.base/sun.nio.ch.NioSocketImpl$1.read(Unknown Source)
at java.base/java.net.Socket$SocketInputStream.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.read(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.readHeader(Unknown Source)
at java.base/sun.security.ssl.SSLSocketInputRecord.bytesInCompletePacket(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl.readApplicationRecord(Unknown Source)
at java.base/sun.security.ssl.SSLSocketImpl$AppInputStream.read(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.readBytes(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.implRead(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.lockedRead(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.read(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.lockedRead0(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.read0(Unknown Source)
at java.base/sun.nio.cs.StreamDecoder.read(Unknown Source)
at java.base/java.io.InputStreamReader.read(Unknown Source)
at it.sauronsoftware.ftp4j.NVTASCIIReader.readLine(NVTASCIIReader.java:105)
at it.sauronsoftware.ftp4j.FTPCommunicationChannel.read(FTPCommunicationChannel.java:142)
at it.sauronsoftware.ftp4j.FTPCommunicationChannel.readFTPReply(FTPCommunicationChannel.java:187)
at it.sauronsoftware.ftp4j.FTPClient.currentDirectory(FTPClient.java:1517)
at info.cqs.remotefs.ftp.Ftp4jAdapter.existsDirectory(Ftp4jAdapter.java:527)
at info.cqs.remotefs.RemoteFSBean.existsDirectory(RemoteFSBean.java:465)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(Unknown Source)
at java.base/java.lang.reflect.Method.invoke(Unknown Source)
at info.cqs.remotefs.RemoteFSBean$RemoteFSHandler.invoke(RemoteFSBean.java:520)
at jdk.proxy2/jdk.proxy2.$Proxy12.existsDirectory(Unknown Source)
at se.datadosen.jalbum.RemoteFSNode.discover(RemoteFSNode.java:106)
at se.datadosen.jalbum.RemoteFSNode.isAlbum(RemoteFSNode.java:95)
at se.datadosen.jalbum.RemoteFSTreeCellRenderer.getTreeCellRendererComponent(RemoteFSTreeCellRenderer.java:153)
at java.desktop/javax.swing.plaf.basic.BasicTreeUI$NodeDimensionsHandler.getNodeDimensions(Unknown Source)
at java.desktop/javax.swing.tree.AbstractLayoutCache.getNodeDimensions(Unknown Source)
at java.desktop/javax.swing.tree.VariableHeightLayoutCache$TreeStateNode.updatePreferredSize(Unknown Source)
at java.desktop/javax.swing.tree.VariableHeightLayoutCache$TreeStateNode.expand(Unknown Source)
at java.desktop/javax.swing.tree.VariableHeightLayoutCache$TreeStateNode.expand(Unknown Source)
at java.desktop/javax.swing.tree.VariableHeightLayoutCache.ensurePathIsExpanded(Unknown Source)
at java.desktop/javax.swing.tree.VariableHeightLayoutCache.setExpandedState(Unknown Source)
at java.desktop/javax.swing.plaf.basic.BasicTreeUI.updateExpandedDescendants(Unknown Source)
at java.desktop/javax.swing.plaf.basic.BasicTreeUI$Handler.treeExpanded(Unknown Source)
at java.desktop/javax.swing.JTree.fireTreeExpanded(Unknown Source)
at java.desktop/javax.swing.JTree.setExpandedState(Unknown Source)
at java.desktop/javax.swing.JTree.expandPath(Unknown Source)
at java.desktop/javax.swing.JTree.makeVisible(Unknown Source)
at java.desktop/javax.swing.plaf.basic.BasicTreeUI$Handler.valueChanged(Unknown Source)
at com.formdev.flatlaf.ui.FlatTreeUI.lambda$createTreeSelectionListener$1(FlatTreeUI.java:363)
at java.desktop/javax.swing.tree.DefaultTreeSelectionModel.fireValueChanged(Unknown Source)
at java.desktop/javax.swing.tree.DefaultTreeSelectionModel.notifyPathChange(Unknown Source)
at java.desktop/javax.swing.tree.DefaultTreeSelectionModel.setSelectionPaths(Unknown Source)
at java.desktop/javax.swing.tree.DefaultTreeSelectionModel.setSelectionPath(Unknown Source)
at java.desktop/javax.swing.JTree.setSelectionPath(Unknown Source)
at se.datadosen.jalbum.JPublishWizard$PublishStep.onShow(JPublishWizard.java:1652)
at se.datadosen.component.JWizard$2.actionPerformed(JWizard.java:57)
at se.datadosen.jalbum.JPublishWizard$AccountsStep$4$1.lambda$operation$0(JPublishWizard.java:452)
at java.desktop/java.awt.event.InvocationEvent.dispatch(Unknown Source)
at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.desktop/java.awt.WaitDispatchSupport$2.run(Unknown Source)
at java.desktop/java.awt.WaitDispatchSupport$4.run(Unknown Source)
at java.desktop/java.awt.WaitDispatchSupport$4.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.desktop/java.awt.WaitDispatchSupport.enter(Unknown Source)
at java.desktop/java.awt.Dialog.show(Unknown Source)
at java.desktop/java.awt.Component.show(Unknown Source)
at java.desktop/java.awt.Component.setVisible(Unknown Source)
at java.desktop/java.awt.Window.setVisible(Unknown Source)
at java.desktop/java.awt.Dialog.setVisible(Unknown Source)
at se.datadosen.component.JSmartDialog.setVisible(JSmartDialog.java:239)
at se.datadosen.jalbum.SlowOperation.launch(SlowOperation.java:82)
at se.datadosen.jalbum.JPublishWizard$AccountsStep$4.actionPerformed(JPublishWizard.java:472)
at se.datadosen.jalbum.JAlbumFrame$JAlbumFrameActions$30.actionPerformed(JAlbumFrame.java:4185)
at se.datadosen.util.AliasAction.actionPerformed(AliasAction.java:79)
at se.datadosen.component.JPopupButton.lambda$initialize$1(JPopupButton.java:159)
at java.desktop/javax.swing.AbstractButton.fireActionPerformed(Unknown Source)
at java.desktop/javax.swing.AbstractButton$Handler.actionPerformed(Unknown Source)
at java.desktop/javax.swing.DefaultButtonModel.fireActionPerformed(Unknown Source)
at java.desktop/javax.swing.DefaultButtonModel.setPressed(Unknown Source)
at java.desktop/javax.swing.plaf.basic.BasicButtonListener.mouseReleased(Unknown Source)
at java.desktop/java.awt.AWTEventMulticaster.mouseReleased(Unknown Source)
at java.desktop/java.awt.AWTEventMulticaster.mouseReleased(Unknown Source)
at java.desktop/java.awt.Component.processMouseEvent(Unknown Source)
at java.desktop/javax.swing.JComponent.processMouseEvent(Unknown Source)
at java.desktop/java.awt.Component.processEvent(Unknown Source)
at java.desktop/java.awt.Container.processEvent(Unknown Source)
at java.desktop/java.awt.Component.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.retargetMouseEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.processMouseEvent(Unknown Source)
at java.desktop/java.awt.LightweightDispatcher.dispatchEvent(Unknown Source)
at java.desktop/java.awt.Container.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Window.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.Component.dispatchEvent(Unknown Source)
at java.desktop/java.awt.EventQueue.dispatchEventImpl(Unknown Source)
at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
at java.desktop/java.awt.EventQueue$4.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
at java.desktop/java.awt.EventQueue$5.run(Unknown Source)
at java.base/java.security.AccessController.doPrivileged(Unknown Source)
at java.base/java.security.ProtectionDomain$JavaSecurityAccessImpl.doIntersectionPrivilege(Unknown Source)
at java.desktop/java.awt.EventQueue.dispatchEvent(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpOneEventForFilters(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForFilter(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEventsForHierarchy(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.pumpEvents(Unknown Source)
at java.desktop/java.awt.EventDispatchThread.run(Unknown Source)
RemoteFSHandler: Caught java.io.IOException: it.sauronsoftware.ftp4j.FTPIllegalReplyException when calling getFiles. Reconnecting
RemoteFSHandler: Caught java.io.IOException: it.sauronsoftware.ftp4j.FTPDataTransferException: I/O error in data transfer when calling getFiles. Reconnecting
RemoteFSHandler: Caught java.net.SocketException: Connection reset when calling getFiles. Reconnecting

Edited by: wolf-skate on 29 Jan 2024, 21:54
davidekholm

Posts: 3,492
Registered: 18-Oct-2002
Re: Album Uploads 'Hang' (stop working)
Posted: 30 Jan 24, 14:07   in response to: wolf-skate in response to: wolf-skate 		 
  Click to reply to this thread Reply
The thread dump file unfortunately didn't reveal any hanging threads. They must have quit before.

The console thread dump reveals a problem asking the ftp server to report the current directory. I can't imagine HOW such a simple IO call can cause a timeout unless there is a serious network problem. Try restarting your router. Also try uploading the "Sample Project" gallery. Does that work fine?
wolf-skate

Posts: 47
Registered: 1-Sep-2009
Re: Album Uploads 'Hang' (stop working)
Posted: 30 Jan 24, 15:00   in response to: davidekholm in response to: davidekholm 		 
  Click to reply to this thread Reply
Attachment thread-dump-1.txt (50.8 KB)
Attachment Screen Shot 01-30-24 at 02.45 PM.PNG (9.4 KB)
Attachment Screen Shot 01-30-24 at 02.42 PM.PNG (6.9 KB)
hmm now I can't get access to server at all see screen shot

BUT no problem via FileZilla

the Firewall warning?? just normal W10 thing..but do recall the last problem w JA's FTPES package and this sever was no access w/o I used a VPN to get (is a work PC run from home and VPN hooked my up directly to work network and out). Will try that later

now just trying upload a gain (w/o VPN) and gets in but hangs at 18Mb, same : RemoteFSHandler: Caught java.net.UnknownHostException:xxx when calling connect. Reconnecting

Edited by: wolf-skate on 30 Jan 2024, 15:06
yes wireless router was turned off at night/open-restart morning both yesterday and today.., yes connection is slowish but can still see/stream the news..now more detail in upload error
java.net.UnknownHostException: ftp.giversen.net
at java.base/sun.nio.ch.NioSocketImpl.connect(Unknown Source)
at java.base/java.net.SocksSocketImpl.connect(Unknown Source)
at java.base/java.net.Socket.connect(Unknown Source)
at it.sauronsoftware.ftp4j.FTPConnector.tcpConnectForCommunicationChannel(FTPConnector.java:208)
at it.sauronsoftware.ftp4j.connectors.DirectConnector.connectForCommunicationChannel(DirectConnector.java:39)
at it.sauronsoftware.ftp4j.FTPClient.connect(FTPClient.java:1006)
at info.cqs.remotefs.ftp.Ftp4jAdapter.connect(Ftp4jAdapter.java:254)
at info.cqs.remotefs.RemoteFSBean.reconnect(RemoteFSBean.java:314)
at info.cqs.remotefs.RemoteFSBean$RemoteFSHandler.invoke(RemoteFSBean.java:535)
at jdk.proxy2/jdk.proxy2.$Proxy12.setDirectory(Unknown Source)
at se.datadosen.jalbum.UploadBean.getExistingAlbumFiles(UploadBean.java:676)
at se.datadosen.jalbum.JPublishWizard$DiskSpaceReporter.lambda$new$2(JPublishWizard.java:2543)
at java.base/java.util.concurrent.FutureTask.run(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source)
at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source)
at java.base/java.lang.Thread.run(Unknown Source)

Edited by: wolf-skate on 30 Jan 2024, 15:38
VPN did not solve problem..also hangs (have asked server host if he did any setup changes during weekend, not replied yet. He is providing hosting for small industry/institutions w big data (geo, astro etc) and I am one of few private customers I guess.
JeffTucker

Posts: 8,245
Registered: 31-Jan-2006
Re: Album Uploads 'Hang' (stop working)
Posted: 30 Jan 24, 15:18   in response to: wolf-skate in response to: wolf-skate 		 
  Click to reply to this thread Reply
I strongly suggest you start using SFTP. The other "semi-secure" connection methods have often proven to be problematic. I had trouble with them several years ago - since switching to SFTP, I've never had a failure.
davidekholm

Posts: 3,492
Registered: 18-Oct-2002
Re: Album Uploads 'Hang' (stop working)
Posted: 30 Jan 24, 15:24   in response to: wolf-skate in response to: wolf-skate 		 
  Click to reply to this thread Reply
The "java.net.UnknownHostException: ftp.giversen.net" error indicates a very shaky network connection. I recommand that you run a ping test for a few hours and see how many dropped packets you get, then take action to get a stable connection.
wolf-skate

Posts: 47
Registered: 1-Sep-2009
Re: Album Uploads 'Hang' (stop working)
Posted: 31 Jan 24, 19:38   in response to: davidekholm in response to: davidekholm 		 
  Click to reply to this thread Reply
ok update:
can not ping my host (disabled security wise, as said his business is professionals w big data and has other trade offs than supporting a private customer as me). Use open web based pings to other serves in DK..yes fluctuates a bit from maybe 50ms to 150ms). Host not made any set up changes for a while, so not reason

Only low tech here and now way to maybe get better connection = open the window (did though not change from the 3/5 bar signal reading from before) as wireless modem. Luckily not freezing out side but only 6C was bit fresh the hour it lasted. Yes counting files went through on 3rd attempt (FZ is NOT so fuzzy in making connection) -> then ok for upload..BUT 1,05GB??? (thats about 40% of the 2,4GB album and I only updated w two small folders) = thus took a full hour to get all uploaded (and yes now working). For test then try enter upload again = promptly JA responds 2,4Gb size not file counting = is that due to the manifest file written at end of successful upload? (could this explain why not had problem before, just build on top of previous successful uploads?)

Anyway a small feedback request wrt the uploading progress. Above the blue bar showing the size/speed of current upload.
One line says progress thumbs/slides (1..8 =threads?)
next line lists the actual file name xxnn.jpg/mp4 etc
now there is 'interwoven' some extra information: first line shows with the blink of eye the folder being process, but so fast I cannot really se what it is. 2nd line also shows some image comments if any = also too fast to see what it is, and also not needed

Suggestion what to show:
1st line ONLY the folder/path being processed, so time to read it
2nd line merge the files/thumbs count info w the actual file name (forget about image comments)

this way if things halt, I can see where the processing stopped and I might have a chance to make a small manual repair (depending of size of what is left to be uploaded)
davidekholm

Posts: 3,492
Registered: 18-Oct-2002
Re: Album Uploads 'Hang' (stop working)
Posted: 1 Feb 24, 14:41   in response to: wolf-skate in response to: wolf-skate 		 
  Click to reply to this thread Reply
Hi. As far as I know, comments are not shown during upload, only parent folder names and file names. You can also increase the logging level under Preferences to have each file name printed to the system console during transfer.

The number printed within parenthesis is the connection/thread number used when using multiple connections.

Yes, if the comparison time is short now, then that means that jAlbum finds and uses the manifest file from the previous upload.

If you find jAlbum uploading far more data then it should, then pay close attention so it's not remaking more stuff than needed: This is indicated before and during album builds with an orange asterisk in the lower-left corner. Click it to reveal what change to settings that causes the rebuild.
Pages: 1
Back to Thread List Back to Thread List
Threads: [ Previous | Next ]
Legend
Forum admins
Helpful Answer
Correct Answer

Point your RSS reader here for a feed of the latest messages in all forums