I also met the same problem and I was able to get it through. So let me explain the steps I applied. I shall explain it according to your scenario.
According to my method we need to use 'Path' class and 'Assembly' class in order to get the relative path.
So first Import System.IO and System.Reflection in using statements.
Then type the below given code line.
var outPutDirectory = Path.GetDirectoryName(Assembly.GetExecutingAssembly(). CodeBase);
Actually above given line stores the path of the output directory of your project.(Here 'output' directory refers to the Debug folder of your project).
Now copy your FolderIcon directory in to the Debug folder. Then type the below given Line.
var iconPath = Path.Combine(outPutDirectory, "FolderIcon\\Folder.ico");
Now this 'iconPath ' variable contains the entire path of your Folder.ico. All you have to do is store it in a string variable. Use the line of code below for that.
string icon_path = new Uri(iconPath ).LocalPath;
Now you can use this icon_path string variable as your relative path to the icon.
Thanks.