Download multiple files from website using wildcards

SO how do we make up, whicj item in the list if a file and which is a sub-directory, so that we can start recursion to fetch contents of a sub-directory? I did it with string parsing. So i differentiated it from there. Also, i could not find any other solution. Do you know of some other elegant solution? Thanks again And people like Andrew should better keep their foul mouths shut..

Aman Sura, The only other way i can suggest of doing this is by checking if there is an extension. If it has an extension it is a file, otherwise it's a directory. In a sense is the same concept as yours, but yours is a more exact approach since a file could be extensionless. Thanks Jonas for giving me your time. Thanks a lot once again. I think till the time. NET gives us some API to get list of files and directories, we have to deal with things this way only.

Hi, Code is looking good and works fine. I have a problem: I want to download two types of files everytime. I want to download all files, which are of type. This a real requirement and urgent.

Thanks and regards, rcm. Thank you very much for posting this! Add a comment. Active Oldest Votes. I think these switches will do what you want with wget : -A acclist --accept acclist -R rejlist --reject rejlist Specify comma-separated lists of file name suffixes or patterns to accept or reject.

Improve this answer. A shell variable, see bash man page. Use option -nd to save all files to the current directory, without hierarchy of directories, example: wget -r -nd --no-parent -A 'bar. Sign up or log in Sign up using Google. Sign up using Facebook. Sign up using Email and Password. Post as a guest Name. Email Required, but never shown. The Overflow Blog. Who owns this outage? Find centralized, trusted content and collaborate around the technologies you use most.

Connect and share knowledge within a single location that is structured and easy to search. How to download multiple files with a wildcard pattern using webclient DownloadFile? You cannot iterate over the list of files from a URL as there is no way to 'retrieve a list of files' from an arbitrary URL.

Stack Overflow for Teams — Collaborate and share knowledge with a private group. Create a free Team What is Teams? Collectives on Stack Overflow. Learn more. Sam I can't resolve the address you provided to debug.

I tried the IP's listed and they don't work either. If you modified the IP's or name you can contact me directly. At this point, I don't know what else to try. If the site requires you to login then you may need to enter that info into your wget options.

I was doing a little work on the system and needed to refer back to the thread here. Realized I never posted the working solution. This will manually DL antivirus updates from Trend Micro. Thread Tools. BB code is On. Smilies are On. All times are GMT The time now is PM. Twitter: linuxquestions. Open Source Consulting Domain Registration. Search Blogs. Mark Forums Read. User Name.