Wget user agent avoidance



I use wget a LOT. Many times in working with a website I’ve got a ssh console opened to the site and if there’s a plugin that I’d like to download it doesn’t make sense to download and then upload, I want to just download it directly from xyz.com webserver to the website where it will be installed. However, many times people have set up rules to block wget downloads. Yes, I know people use wget to suck down entire websites, it uses up bandwidth, etc. etc. Well. Wget is capable of sending a different user-agent.


First off, the way you are tipped off that wget is disliked is if you’ve just visited the site and then try wget and get a message like this…

“HTTP request sent, awaiting response… 403 Forbidden”

essentially, if you add –user-agent=MSIE it might bypass user-agent filtering.

Related Posts

Blog Traffic Exchange Related Posts
  • More Sony DRM news It looks like a list of Sony Music titles with the recent onerous DRM "rootkit" is being gathered. The Sunbelt blog has links to several lists. The EFF has a list here, there are two others though out there, here and here. Among other things, another post mentions the stupid......
  • Recovering a Split BiggieFile from a MondoRescue Backup Once upon a time I wrote of manually extracting a file from a mondorescue backup. Sometimes it's just easier to do that, than have mondorescue go through 30 some cds or dvds just to find one file. (Not to mention the fact that the iso's aren't burned to disc but......
  • Remote Tech Support with x11vnc and wrapper script So, the idea is that I wanted something "like" the Ultranvnc Single Click download, only for linux. The main idea being is that if someone is looking for a bit of desktop tech support on linux, we don't need to be giving instructions for 5 different package managers, or source......
Blog Traffic Exchange Related Websites
  • 7 Things People Spend More Money on Than They Should (and Tips to Stop Doing it). Saving money is always a good thing and with the recent recession, more people are casting an eye on their expenses in the hopes of cutting back. It's not just a good idea during recession. If more people became more watchful of their spending, then the country as a whole......
  • Microsoft Blogs Review Reading and reviewing corporate blogs from other companies is a great way to learn a little bit more about your own blog. Microsoft has a large community of blogs, and a wide variety of bloggers writing in numerous blogs within this community. There are a number of employee blogs in......
  • Social Bookmarking-It Can Be Very Useful You might have perhaps noticed a good deal regarding social bookmark submitting lately. Ought to be fact, possibilities are big money today just to discover what all is here. Properly, not really below. I am giving you these records.Used to the study and located this particular to become a very......
www.pdf24.org    Send article as PDF   

Similar Posts


See what happened this day in history from either BBC Wikipedia
Search:
Keywords:
Amazon Logo

Comments are closed.


Switch to our mobile site