I know it's possible to get an empty HTTP_REFERER. Under what circumstances does this happen? If I get an empty one, does it always mean that the user changed it? Is getting an empty one the same as getting a null one? and under what circumstances do I get that too?
5 Answers
It will/may be empty when the enduser
- entered the site URL in browser address bar itself.
- visited the site by a browser-maintained bookmark.
- visited the site as first page in the window/tab.
- clicked a link in an external application.
- switched from a https URL to a http URL.
- switched from a https URL to a different https URL.
- has security software installed (antivirus/firewall/etc) which strips the referrer from all requests.
- is behind a proxy which strips the referrer from all requests.
- visited the site programmatically (like, curl) without setting the referrer header (searchbots!).
-
35You might want to add "when the user transitions from a secure (HTTPS) page to an insecure one". Apr 3, 2012 at 4:50
-
4"visited the site as first page in the window/tab." Even if it was by clicking an on link and opening it in a new window/tab?? Are you sure? That would be a very wrong behavior of the browser– matteoMar 25, 2013 at 0:14
-
Also see here stackoverflow.com/questions/21922143/… for exeptions to this– GetFreeJan 21, 2015 at 4:54
-
6"switched from a https URL to a different https URL". Are you sure about this? :\ Jun 2, 2016 at 5:10
-
7By default, switching from an HTTPS URL to a different HTTPS URL does set the full referer. This default policy can however be overridden. w3.org/TR/referrer-policy Feb 3, 2017 at 14:38
HTTP_REFERER - sent by the browser, stating the last page the browser viewed!
If you trusting [HTTP_REFERER] for any reason that is important, you should not, since it can be faked easily:
- Some browsers limit access to not allow HTTP_REFERER to be passed
- Type a address in the address bar will not pass the HTTP_REFERER
- open a new browser window will not pass the HTTP_REFERER, because HTTP_REFERER = NULL
- has some browser addon that blocks it for privacy reasons. Some firewalls and AVs do to.
Try this firefox extension, you'll be able to set any headers you want:
@Master of Celebration:
Firefox:
extensions: refspoof, refontrol, modify headers, no-referer
Completely disable: the option is available in about:config under "network.http.sendRefererHeader" and you want to set this to 0 to disable referer passing.
Google chrome / Chromium:
extensions: noref, spoofy, external noreferrer
Completely disable: Chnage ~/.config/google-chrome/Default/Preferences or ~/.config/chromium/Default/Preferences and set this:
{
...
"enable_referrers": false,
...
}
Or simply add --no-referrers to shortcut or in cli:
google-chrome --no-referrers
Opera:
Completely disable: Settings > Preferences > Advanced > Network, and uncheck "Send referrer information"
Spoofing web service:
Standalone filtering proxy (spoof any header):
Spoofing http_referer when using wget
‘--referer=url’
Spoofing http_referer when using curl
-e, --referer
Spoofing http_referer wth telnet
telnet www.yoursite.com 80 (press return)
GET /index.html HTTP/1.0 (press return)
Referer: http://www.hah-hah.com (press return)
(press return again)
-
Tamper Data is another Firefox extension that's worth a look if you want to play with changing referrer values. Jul 30, 2011 at 2:32
-
I was trying really hard to remember it's name. but my memory betrayed me. Thanks:)– ThatGuyJul 30, 2011 at 2:35
-
@nix
Some browsers limit access to not allow HTTP_REFERER to be passed
Could you please name an example for such browser and/or extension? May 15, 2012 at 10:49 -
@MasterofCelebration added ways to spoof http_referer into my answer.– ThatGuyMay 18, 2012 at 18:54
-
Do not use referer.us to spoof / hide your referrer! It does not work and leaks your information. The only working service right now is this free hide referrer service. Mar 30, 2017 at 2:44
It will also be empty if the new Referrer Policy standard draft is used to prevent that the referer header is sent to the request origin. Example:
<meta name="referrer" content="none">
Although Chrome and Firefox have already implemented a draft version of the Referrer Policy, you should be careful with it because for example Chrome expects no-referrer
instead of none
(and I have seen also never
somewhere).
-
browser compatibility table: developer.mozilla.org/en-US/docs/Web/HTTP/Headers/…– djvgNov 29, 2019 at 9:52
BalusC's list is solid. One additional way this field frequently appears empty is when the user is behind a proxy server. This is similar to being behind a firewall but is slightly different so I wanted to mention it for the sake of completeness.
I have found the browser referer implementation to be really inconsistent.
For example, an anchor element with the "download" attribute works as expected in Safari and sends the referer, but in Chrome the referer will be empty or "-" in the web server logs.
<a href="http://foo.com/foo" download="bar">click to download</a>
Is broken in Chrome - no referer sent.