Wget user agent avoidance



I use wget a LOT. Many times in working with a website I’ve got a ssh console opened to the site and if there’s a plugin that I’d like to download it doesn’t make sense to download and then upload, I want to just download it directly from xyz.com webserver to the website where it will be installed. However, many times people have set up rules to block wget downloads. Yes, I know people use wget to suck down entire websites, it uses up bandwidth, etc. etc. Well. Wget is capable of sending a different user-agent.


First off, the way you are tipped off that wget is disliked is if you’ve just visited the site and then try wget and get a message like this…

“HTTP request sent, awaiting response… 403 Forbidden”

essentially, if you add –user-agent=MSIE it might bypass user-agent filtering.

Related Posts

Blog Traffic Exchange Related Posts
  • Remote Tech Support with x11vnc and wrapper script So, the idea is that I wanted something "like" the Ultranvnc Single Click download, only for linux. The main idea being is that if someone is looking for a bit of desktop tech support on linux, we don't need to be giving instructions for 5 different package managers, or source......
  • Photoshop and news pictures... There was a time when people looked to shape images for political benefit. (I mean political in most ALL senses of the word whether it's domestic or international or issue oriented politics etc.) By this I mean, "Framing the picture" the right way, in front of a banner, cropping tight......
  • How to Remove AntiAdd | AntiAdd Removal Guide AntiAdd is a rogue antivirus application. It is installed via trojans that claim to be video codec or flash player updates and then once installed on the system it will claim to be scanning your computer and discovering all sorts of viral infected files. In addition to this it may......
Blog Traffic Exchange Related Websites
  • Search History - Today And Tomorrow It could sound a bit scary but every single stroke of my keyboard is recorded by the laptop or computer memory. You had been looking for particular info on the web. In several days whenever you required to check out the similar pages again, to your utter dismay, you......
  • Reasons People Find Hard Time To Make A Living With Affiliate Marketing One of the biggest reasons why most will struggle to make a single dollar with Affiliate Marketing is the inability to take action. Unfortunately those entering "make money online" world tend to be those looking to make instant riches without putting in the hard yards to be successful. It's not......
  • Finovate Startup 2009 Live Twitter I am attending Finovate Startup 2009. It is an action packed 1 day format which I belive will lend itself perfectly to a live twitter. Stay tuned it should be an amazing day. http://twitter.com/BlogTrafficExch In the break I have scheduled some talks with SimplFi, Mint, and Calendar Budget. I am......
en.pdf24.org    Send article as PDF   

Similar Posts


See what happened this day in history from either BBC Wikipedia
Search:
Keywords:
Amazon Logo

Comments are closed.


Switch to our mobile site