Wget user agent avoidance



I use wget a LOT. Many times in working with a website I’ve got a ssh console opened to the site and if there’s a plugin that I’d like to download it doesn’t make sense to download and then upload, I want to just download it directly from xyz.com webserver to the website where it will be installed. However, many times people have set up rules to block wget downloads. Yes, I know people use wget to suck down entire websites, it uses up bandwidth, etc. etc. Well. Wget is capable of sending a different user-agent.


First off, the way you are tipped off that wget is disliked is if you’ve just visited the site and then try wget and get a message like this…

“HTTP request sent, awaiting response… 403 Forbidden”

essentially, if you add –user-agent=MSIE it might bypass user-agent filtering.

Popularity: 1% [?]

PDF    Send article as PDF   
Blog Traffic Exchange Related Posts
  • Photoshop and news pictures... There was a time when people looked to shape images for political benefit. (I mean political in most ALL senses of the word whether it's domestic or international or issue oriented politics etc.) By this I mean, "Framing the picture" the right way, in front of a banner, cropping tight......
  • Remote Tech Support with x11vnc and wrapper script So, the idea is that I wanted something "like" the Ultranvnc Single Click download, only for linux. The main idea being is that if someone is looking for a bit of desktop tech support on linux, we don't need to be giving instructions for 5 different package managers, or source......
  • More Sony DRM news It looks like a list of Sony Music titles with the recent onerous DRM "rootkit" is being gathered. The Sunbelt blog has links to several lists. The EFF has a list here, there are two others though out there, here and here. Among other things, another post mentions the stupid......
Blog Traffic Exchange Related Websites
  • Get Twitter Followers: Essentials The notion of seeking to get Twitter followers may be a consistent factor for many individuals. Twitter is ideally a communication instrument nevertheless it could be used in a great number of different approaches by different folks. Twitter shouldn't be only a indicates of interacting but in addition an helpful......
  • Microsoft Blogs Review Reading and reviewing corporate blogs from other companies is a great way to learn a little bit more about your own blog. Microsoft has a large community of blogs, and a wide variety of bloggers writing in numerous blogs within this community. There are a number of employee blogs in......
  • FMU Shirts Back in Stock! Get Them While They're Hot! Hey, hey, hey Fat Man Unleashed (FMU) fans! We want you to know how much we love you and appreciate your support. Your comments and feedback on our articles are awesome and we love hearing what you have to say. We love sharing our ideas and fitness tips with people......

Similar Posts


See what happened this day in history from either BBC Wikipedia
Search:
Keywords:
Amazon Logo

Comments are closed.


Switch to our mobile site