|Subject:||Set Referrer header|
The most common browsers use the Referrer header, and we are trying to mimic them. Also, some sites [mistakenly] rely on it. It should be noted however that some people don't like the Referrer header, and implementation varies: some browsers don't use it, some only use it within the same site/domain, others easily allow their users to fake it. So perhaps its use should be made optional. So, when we are using any of the link following or form submitting methods we should set the Referrer header. However, methods such as get() should not set it when they are called directly. This may cause a slight complication during implementation (as the request object (that we need to set the header on) is created within get(), and get() is called from follow() and follow_link()).