I want to evaluate and compare the result of my community detection algorithm in R. My algorithm doesn't allow overlapping, and there are some nodes that are not treated. For example, for the Zachary Karate club, I have 1 node not treated. I've found a lot of metrics (NMI, ARI, Modulaity(Q), Purity, Rank Index...), and I don't which ones are the best. Currently, I'm use the modularity, purity and the Rank Index.
Are those chosen evaluation metrics are sufficient?
For example, for the Rank Index is the RI(P,R)= (a+d)/(a+b+c+d) where a, b, c and d be the number of pairs of nodes that are respectively in a same community according to P and R, in a same community according to P but in different communities according to R, in different communities as given by P but in a same community as given by R, and in different communities according to both P and R, and P = {p1, p2, . . . , pk} be the output of a community detection algorithm applied to graph G =< V,E >, and R = {r1, r2, . . . , rn} be the real community structure.
So if I deal with a large graph, how can I calculate those values? Where can I find R(the real community structure)?