FTP Transfer speed extremly slow compared to FileZilla/WinSCP where the same file uploads instantly
Hello, I'm noticing extremly slow speeds when working with our server over the FTP using the Remote Host (Deployment) tool window. My upload speed is usually around 500bit/s. I think this should be (bytes/s as otherwise the time reported dont make sense). When I try to upload the same file to the same server using filezilla or winscp its instant. I'm using passive mode, and have all file checks (modified/timestamps etc) disabled. Below are details from my last transfer and an excerpt from the idea.log.
The upload took 18 seconds the file is 3.7KB (this is 32768 bits which at 325bit/s should take 100seconds so I dont think the speed reported in the log is correct, if it was 325bytes/s it would make it around 13seconds treansfer time and 5 seconds for handshakes I guess? Still seems insane). Any idea why it could be so slow? Or is this normal and no-one else is complaining?
Screenshot of my remote host Options:
remote host advanced settings:
Transfer details:
[6.11.2018 3:41 PM] Upload to CMSFTP
[6.11.2018 3:41 PM] Upload file 'C:\Dev\CMSversioning\IDC.com\SECTIONS\promo\sap\TEMPLATES\sablona-section.ftl' to '/IDC.com/SECTIONS/promo/sap/TEMPLATES/sablona-section.ftl'
[6.11.2018 3:42 PM] Upload to CMSFTP completed in less than a minute: 1 file transferred (351 bit/s)
Log:
2018-11-06 15:41:45,871 [1633989] DEBUG - t.connections.RemoteConnection - Opening connection to ftp://usfr-sage-cms.insideidc.com:8021/ in @79317914
2018-11-06 15:41:45,871 [1633989] DEBUG - t.connections.RemoteConnection - Added connection to pool offtp://usfr-sage-cms.insideidc.com:8021/ in @79317914; 1 connections exists
2018-11-06 15:41:45,871 [1633989] DEBUG - ains.plugins.webDeployment.ftp - PASV
2018-11-06 15:41:45,983 [1634101] DEBUG - ains.plugins.webDeployment.ftp - 227 Entering Passive Mode (10,1,4,147,155,153)
2018-11-06 15:41:46,099 [1634217] DEBUG - ains.plugins.webDeployment.ftp - LIST IDC.com/SECTIONS/promo/sap/TEMPLATES
2018-11-06 15:41:49,176 [1637294] DEBUG - ains.plugins.webDeployment.ftp - 150 File status okay; about to open data connection.
2018-11-06 15:41:52,104 [1640222] DEBUG - ains.plugins.webDeployment.ftp - -rw------- 0 null null 98903 Dec 31 1969 page-sap.ftl
2018-11-06 15:41:52,105 [1640223] DEBUG - ains.plugins.webDeployment.ftp - -rw------- 0 null null 3834 Dec 31 1969 sablona-section.ftl
2018-11-06 15:41:52,105 [1640223] DEBUG - ains.plugins.webDeployment.ftp -
2018-11-06 15:41:52,105 [1640223] DEBUG - ains.plugins.webDeployment.ftp - 226 Closing data connection.
2018-11-06 15:41:52,105 [1640223] DEBUG - ins.webDeployment.TransferTask - Starting server-side modification
2018-11-06 15:41:52,105 [1640223] DEBUG - ins.webDeployment.TransferTask - Publish config:
<State autoUpload="Never" promptOnRemoteOverwrite="NONE" serverName="CMSFTP" stopOnFirstError="true" overwriteAll="true" preserveTimestamps="false" deleteMissingItems="false" createEmptyFolders="false" traceLevel="DETAILS" promptOnLocalOverwrite="false" persistUploadOnCheckin="true" exclude=".svn;.cvs;.idea;.DS_Store;.git;.hg;*.hprof;*.pyc" filePermissions="-1" folderPermissions="-1" showDialogOnRemoteDnD="false" autoUploadExternalChanges="false" notifyRemoteChanges="false" compareModeInSync="CONTENT" showEqualInSync="false" showDifferentInSync="true" showNewOnSourceInSync="true" showNewOnTargetInSync="true" showExcludedInSync="false">
<servers />
<serverData>
<paths name="CMSFTP">
<serverdata>
<mappings>
<mapping deploy="/" local="C:/Dev/CMSversioning/" web="/" />
</mappings>
<excludedPaths />
</serverdata>
</paths>
</serverData>
<option name="myUploadOnCheckinName" />
<option name="myAutoUpload" value="NEVER" />
</State>
2018-11-06 15:41:52,105 [1640223] DEBUG - ins.webDeployment.TransferTask - Server config: class com.jetbrains.plugins.webDeployment.config.ServerPasswordSafeDeployable
<webServer id="2c533eca-b254-4f97-9eda-74c4cefccc57" name="CMSFTP" url="http://usfr-sage-cms.insideidc.com">
<fileTransfer anonymous="false" explicitFtps="true" host="usfr-sage-cms.insideidc.com" port="8021" rootFolder="/" accessType="FTP" authAgent="false" keyPair="false">
<advancedOptions>
<advancedOptions compatibilityMode="false" controlEncoding="windows-1252" dataProtectionLevel="Private" forceListCommand="true" keepAliveCommand="NOOP" keepAliveTimeout="300000" maxConnections="2147483647" muteSftpMessages="false" passiveMode="true" accurateTimestamps="NEVER" shareSSLContext="false" showHiddenFiles="false" />
</advancedOptions>
<option name="port" value="8021" />
</fileTransfer>
</webServer>
2018-11-06 15:41:52,106 [1640224] DEBUG - ains.plugins.webDeployment.ftp - PASV
2018-11-06 15:41:52,247 [1640365] DEBUG - ains.plugins.webDeployment.ftp - 227 Entering Passive Mode (10,1,4,147,215,156)
2018-11-06 15:41:52,362 [1640480] DEBUG - ains.plugins.webDeployment.ftp - STOR IDC.com/SECTIONS/promo/sap/TEMPLATES/sablona-section.ftl
2018-11-06 15:41:55,276 [1643394] DEBUG - ains.plugins.webDeployment.ftp - 150 File status okay; about to open data connection.
2018-11-06 15:41:57,199 [1645317] DEBUG - ains.plugins.webDeployment.ftp - 226 Transfer complete.
2018-11-06 15:41:57,199 [1645317] DEBUG - ains.plugins.webDeployment.ftp - PASV
2018-11-06 15:41:57,311 [1645429] DEBUG - ains.plugins.webDeployment.ftp - 227 Entering Passive Mode (10,1,4,147,164,154)
2018-11-06 15:41:57,425 [1645543] DEBUG - ains.plugins.webDeployment.ftp - LIST IDC.com/SECTIONS/promo/sap/TEMPLATES
2018-11-06 15:42:00,250 [1648368] DEBUG - ains.plugins.webDeployment.ftp - 150 File status okay; about to open data connection.
2018-11-06 15:42:03,037 [1651155] DEBUG - ains.plugins.webDeployment.ftp - -rw------- 0 null null 98903 Dec 31 1969 page-sap.ftl
2018-11-06 15:42:03,037 [1651155] DEBUG - ains.plugins.webDeployment.ftp - -rw------- 0 null null 3834 Dec 31 1969 sablona-section.ftl
2018-11-06 15:42:03,037 [1651155] DEBUG - ains.plugins.webDeployment.ftp -
2018-11-06 15:42:03,037 [1651155] DEBUG - ains.plugins.webDeployment.ftp - 226 Closing data connection.
2018-11-06 15:42:03,038 [1651156] DEBUG - ebDeployment.TransferOperation - Transferred: /Dev/CMSversioning/IDC.com/SECTIONS/promo/sap/TEMPLATES/sablona-section.ftl
2018-11-06 15:42:03,039 [1651157] DEBUG - ins.webDeployment.TransferTask - finished
2018-11-06 15:42:03,039 [1651157] DEBUG - t.connections.RemoteConnection - Releasing one of the connections to ftp://usfr-sage-cms.insideidc.com:8021/ in @79317914; connections left 0
Please sign in to leave a comment.
Answered in corresponding support ticket.
Hello, can you please share an answer about this issue.
It's really annoing to work with an IDE when you have to wait hours to deploy project.
I work with IDEA because I liked it's functionalities, but it's possible to alway lost hours because of this type of lacks, and really now I don't think I will stay like this.
@Nicolas, hey so in our case the issue is on our server. Unfortunately our devs are not able to figure it out so I cant help. But its not Jet Brains' problem
We're also seeing painfully slow uploads. I'm not sure how it's not a Jet Brains problem when other programs don't seem to have this issue.
@Adam, we'll need a more detailed description with deployment logs attached. Please add
#com.jetbrains.plugins.webDeploymentto Help | Debug Log Settings, restart IDEA, initiate an upload that would be slow, collect the logs bundle (Help | Compress Logs) and attach it to a support ticket. Thank you!