Wget user agent avoidance



I use wget a LOT. Many times in working with a website I’ve got a ssh console opened to the site and if there’s a plugin that I’d like to download it doesn’t make sense to download and then upload, I want to just download it directly from xyz.com webserver to the website where it will be installed. However, many times people have set up rules to block wget downloads. Yes, I know people use wget to suck down entire websites, it uses up bandwidth, etc. etc. Well. Wget is capable of sending a different user-agent.


First off, the way you are tipped off that wget is disliked is if you’ve just visited the site and then try wget and get a message like this…

“HTTP request sent, awaiting response… 403 Forbidden”

essentially, if you add –user-agent=MSIE it might bypass user-agent filtering.

Related Posts

Blog Traffic Exchange Related Posts
  • How to Remove Win Security 360 | Win Security 360 Removal Guide Win Security 360 is a rogue antivirus application that is promoted through the use of trojans and other malware as well as sites that claim to do malware scans of your computer. Among the things that it will do is schedule itself to run when the system boots and it......
  • Clamav 0.88.1 for Mandrake 10.0 Since, I've still got a few older Mandrake 10 installs that I'm maintaining as mailservers, there aren't supported security fixes for various things anymore... Friday there was news of a new clamantivirus to fix some security flaws with 0.88, new version is 0.88.1 I've taken the cooker srpm and recompiled......
  • Photoshop and news pictures... There was a time when people looked to shape images for political benefit. (I mean political in most ALL senses of the word whether it's domestic or international or issue oriented politics etc.) By this I mean, "Framing the picture" the right way, in front of a banner, cropping tight......
Blog Traffic Exchange Related Websites
  • Download Flash Video from Any Website Do you want to download a flash video? Are you having trouble finding a good program or plugin to rip flash videos? Do you want to know how to download flash video from any website? You've come to the right place. There are lots of programs and browser plugins that......
  • Search History - Today And Tomorrow It could sound a bit scary but every single stroke of my keyboard is recorded by the laptop or computer memory. You had been looking for particular info on the web. In several days whenever you required to check out the similar pages again, to your utter dismay, you......
  • How To Get Higher Targeted Traffic From YouTube If you've got a website or a blog, you need traffic. Without traffic, your site or blog will be, at best, a ghost town. The more people know about your website, the better it is going to be. Even though there are a lot of different strategies to raise traffic......
en.pdf24.org    Send article as PDF   

Similar Posts


See what happened this day in history from either BBC Wikipedia
Search:
Keywords:
Amazon Logo

Comments are closed.


Switch to our mobile site