Remote File Mask to load a directory quickly???

Core FTP client questions and answers
Post Reply
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Remote File Mask to load a directory quickly???

Post by equilter »

Hello. I have a directory to which I upload files regularly with over 60,000 .jpg files. Since I only have about a dozen gif files, I enter ".gif" into the file mask to hopefully only load the directory with a few files quickly. However, when I enter ".gif" into the file mask and load the directory, it retrieves the ENTIRE directory contents from the server, which apparently is too much for coreftp, and it errors with "Error loading directory, 461 Transfer aborted, broken pipe".

Is there any way to retrieve a remote directory on a Linux box that will ONLY get the ".gif" file mask files, instead of the entire directory?

With a older version of a competing product, it worked perfectly, with almost instant listing of this directory. However, I'd like to find a product that supports SSL AND can handle this directory properly.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

I turned Caching OFF, then reconnected. This time it takes 44 seconds to retrieve the directory, only showing the .gif files.

With the competing product, it can download the masked directory almost instantly.

Is there some way to issue the list command to the Linux server to ONLY transfer the list of masked files? This appears to be what happens on the competing product.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Sure thing, here is the relavant section of the log:

LIST *.gif
150 Opening ASCII mode data connection for file list
Received 18906 bytes in 0.4 secs, (490.67 Kbps), transfer succeeded
226 Transfer complete.

Let me know what you think please.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Thank you, that's very encouraging! :wink:
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Hello again, have you been able to address this issue yet?
CP wrote:It does appear there is a way to do this. I'll look into it... :)

Sure thing, here is the relavant section of the log:

LIST *.gif
150 Opening ASCII mode data connection for file list
Received 18906 bytes in 0.4 secs, (490.67 Kbps), transfer succeeded
226 Transfer complete.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Hello and thank you for the new feature in the latest release, build 1469.

It does indeed properly filter the directory listing, however it also seems to apply the file mask to the directories, as well as the files.

In other words, when the file mask is applied, the directories do NOT appear in the list (probably because the directory names don't contain the file mask), so you can no longer navigate the directory structure.

Can this be addressed?
Thank you.
CP wrote:this option will be available in build 1469 and greater under advanced -> directory/folder settings.

It appears that right now there is different behavior on different types of servers due to the interpretation of the asterix (*) wildcard character.

Please feel free to comment on the new feature once it is available.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

What is the "Advanced Directory Listing", and how do I access it?
What will we look for???

Thanx
CP wrote:I believe it's a matter of figuring out what the correct syntax is to return the directories too. The next step is to test using the advanced directory listings with this function and see if it makes a difference.

If that doesn't work, then it would probably make sense to have a drop down list of masks that the user had typed in, so the user can switch between the different types of listings. There may be scenarios where the user does not want to list directories, etc.

Either way, more information is needed to come up with a complete solution to handle this correctly... :?
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

The advanced directory listing turned "ON" makes no difference.
I did notice the command that coreFTP is using for the listing is:

LIST -al *.gif

Which is different than the command that WS_FTP Pro uses (which works correctly, and shows the directory folders):

LIST *.gif

What is the "-al", and can it be removed?
Poky
Posts: 6
Joined: Tue Aug 08, 2006 2:27 am

Post by Poky »

-a Shows you all files, even files that are hidden (these files begin with a dot.)
-l Shows you huge amounts of information (permissions, owners, size, and when last modified.)

Ref: http://www.computerhope.com/unix/uls.htm
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

It's a Linux box running ProFTPD.
I've been using WS_FTP Pro v.6.51, and it works great for the file mask, without filtering out the directory structure. I'd like to move to CoreFTP, as it supports more security.
CP wrote:equilter, what type of server are you connecting to? If you're not sure, you can determine it by looking at the SYST command in the log after connecting.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Hello again. I have the 'Advanced' section filled out to start in a particular directly with a file mask, and the "Include File Mask in LIST" checkbox checked.

However upon connecting, the program does NOT go to the specified directory, NOR does it apply the mask.

Please advise!
CP wrote:the advanced directory listing feature can be turned on by right clicking on the remote directory, selecting directory commands -> list mode -> advanced. It can also be set in the advanced -> general section of your site profile.

This will list files such as .htaccess. It also seems to return directories on the server that I tested with (using wildcard *.html).
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

Still no luck with the latest version. The program does NOT change directory to my specified directory, and it does NOT apply the file mask.

I believe the problem is that when I tell it to go to /test/directory/*.gif

And the default directory for the server is /home/new

The program tries to change directory to /home/new/test/directory/*.gif
which is NOT a valid directory.

I have tried WITH and WITHOUT the "Abs" box checked.

Any ideas?
Thanks
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Still no help with Version 2.1 (build 1547)

Post by equilter »

I installed the latest version, Version 2.1 (build 1547), but the directory listing is still NOT correct.

I believe the problem is that when I tell it to go to /test/directory/*.gif

And the default directory for the server is /home/new

The program tries to change directory to /home/new/test/directory/*.gif
which is NOT a valid directory.
equilter
Posts: 13
Joined: Thu Jan 26, 2006 8:57 pm

Post by equilter »

I'm wondering if there's been any progress on adding a specfic FILE MASK to the Site Manager listing? When you add a mask to the end of the 'Remote Directory', it simply causes CoreFTP to not recognize the directory, and instead goes to the default /home directory.

Please advise.
Post Reply