Questions tagged [elki]
ELKI is an open source data mining software with the focus on cluster analysis and outlier detection. It uses index structures for accelerating these algorithms.
164
questions
0
votes
1
answer
19
views
Getting row indices back from the DBIDs neighbours in ELKI CorePredicate DBCAN
I am currently trying (and struggling) to implement a WeightedCorePredicate to implement the weighteddbscan in elki. The modified code of the core predicate is shown here:
public boolean ...
0
votes
1
answer
42
views
WeightedCorePredicate Implementation for ELKI - An example
I've recently tried to implement an example of the Weighted DBSCAN in ELKI by modifying the CorePredicate (For example, using the MinPointCorePredicate as the base to build on) and I was just ...
0
votes
1
answer
125
views
Elki GDBSCAN Java/Scala - how to modify the CorePredicate
How is the generalised dbscan (gdbscan) in elki implemented in Java/Scala? I am currently trying to find an efficient way to implement a weighted dbscan on elki to offset the inefficiencies coming ...
2
votes
0
answers
52
views
Visualization results of dbscan using ELKI
I am using ELKI's implementation of DBSCAN to cluster.
Could you tell me how can I visualize this data?
DatabaseConnection dbc = new ArrayAdapterDatabaseConnection(data);
Database db = new ...
2
votes
1
answer
1k
views
DBSCAN: How to Cluster Large Dataset with One Huge Cluster
I am trying to perform DBSCAN on 18 million data points, so far just 2D but hoping to go up to 6D. I have not been able to find a way to run DBSCAN on that many points. The closest I got was 1 million ...
0
votes
1
answer
47
views
ELKI: How to Specify Feature Columns of CSV for K-Means
I am trying to run K-Means using ELKI MiniGUI. I have a CSV dataset of 15 features (columns) and a label column. I would like to do multiple runs of K-Means with different combinations of the feature ...
0
votes
1
answer
47
views
ELKI: LOF score as infinite
What is the generally used and accepted way to handle LOF scores as inifinite in ELKI, due to duplicate points? If LOF scores of ELKI to be used, should such scores be considered as maximum-scores, ...
-1
votes
1
answer
172
views
how to install ELKI on windows?
I would like to install ELKI on windows and use clustering methods from python source code. The official documentation on the installation and use of their methods is not clear, which makes it ...
0
votes
1
answer
121
views
Should DBSCAN and its index have the same distance function
Is it required that DBSCAN and its index have the same distance function? If it is not, what are the cases when it is needed to use different distance functions?
Scala code how I create DBSCAN and ...
1
vote
1
answer
209
views
sample_weight option in the ELKI implementation of DBSCAN
My goal is to find outliers in a dataset that contains many near-duplicate points and I want to use ELKI implementation of DBSCAN for this task.
As I don't care about the clusters themselves just the ...
0
votes
1
answer
184
views
Create Dendrogram with Elki
I want to plot a dendrogram for a cluster result. Right now I am using ElkiBuilder from ELKI 0.7.5 for clustering.
In the best case I'd like to directly plot a dendrogram.
If that's not possible I'...
-1
votes
1
answer
179
views
KMeans usage in ELKI, comprehensive example
I'd like to use the KMeans clustering algorithm, for example, Elkan's kmeans from ELKI in Scala to get the centroids of the clusters. A comprehensive example would be great because it's a bit ...
1
vote
1
answer
237
views
How can I cluster data using a distance matrix with the ELKI library?
I have a distance matrix and I want to use that distance matrix when clustering my data.
I've read the ELKI documentation and it states that I can overwrite the distance method when extending the ...
0
votes
1
answer
39
views
ELKI KNNDistancesSampler
Does anybody know what does the KNNDistancesSampler calculate in ELKI? I can see the java code for the function : https://github.com/elki-project/elki/blob/master/elki/src/main/java/de/lmu/ifi/dbs/...
0
votes
1
answer
103
views
Can ELKI cluster non-normalized negative points? [duplicate]
I have gone through this question but the solution doesn't help.
ELKI Kmeans clustering Task failed error for high dimensional data
This is my first time with ELKI so, please bear with me. I have ...
-1
votes
1
answer
30
views
What will be the distanceFunction parameter for elki DBSCAN?
DBSCAN<NumberVector> dbscan = new DBSCAN<NumberVector>(distanceFunction,0.5,10);
dbscan.run(db);
Here what should I put in distanceFunction
0
votes
1
answer
117
views
Showing progress of the ELKI DBSCAN clustering model while the model is running?
I am using ELKI's implementation of DBSCAN to cluster different datasets with various sizes (ranging from millions to thousands of observations), and since it can take quite long time for the ...
3
votes
2
answers
9k
views
Error opening registry key ‘Software\JavaSoft\JRE’ while installing elki
I am trying to download ELKI. So as per the readme file I run the elki.bat( I am using windows 10 ). But I get the following java related errors :
Error: opening registry key ‘Software\JavaSoft\JRE’
...
0
votes
1
answer
38
views
UnsupportedOperationException when using DBSCAN with RStarTree in ELKI
I am using ELKI for clustering and I tried it more than 1k times on many datasets and it was fine :D
but when i run it on one of my files (it was the big one) I see an error in initializing tree.
...
0
votes
1
answer
68
views
Output index of ELKI
I am using ELKI to cluster data from CSV file
I use
-resulthandler ResultWriter
-out folder/
to save the outputdata
But as an output I have some strange indexes
ID=2138 0.1799 0.2761
ID=2137 0....
0
votes
1
answer
48
views
ELKI Default parameter settings for (clustering) algorithms
I'm working on a research project that involves showing visually the result of many clustering results. I saw that the clustering classes always bring their own parameterizer static classes.
Is it ...
0
votes
1
answer
88
views
How to run DatabaseUtil.precomputedKNNQuery method of LOF class on two different threads
I want to reduce runtime of DatabaseUtil.precomputedKNNQuery method by running this method on two different threads and KNNQuery is an interface.
KNNQuery<O> knnq = DatabaseUtil....
1
vote
1
answer
1k
views
Running DBSCAN on GPS Data: Memory Error
For a project that I am currently working on, I need to cluster a relatively large number of pairs of GPS into different location clusters. After reading many posts and suggestions here in ...
0
votes
2
answers
100
views
How to add index in Database using ELKI java API for Custom POJO with String type fields
I am using DBSCAN to cluster some categorical data using a POJO. My class looks like this
public class Dimension {
private String app;
private String node;
private String cluster;
..........
3
votes
2
answers
192
views
Predicting a numeric attribute through high dimensional nominal attributes
I'm having difficulties mining a big (100K entries) dataset of mine concerning logistics transportation. I have around 10 nominal String attributes (i.e. city/region/country names, customers/vessel ...
0
votes
1
answer
217
views
How to use Arrays instead of NumberVector in Elki
I want to use preDistance(double[] v1, double[] v2, int start, int end) function instead of preDistance(NumberVector v1, NumberVector v2, int start, int end). How can i do this? is it possible through ...
0
votes
1
answer
92
views
Elki plots from pure Java API
I've been searching for a way to export ELKI generated visualization into SVG file, which can later be displayed on my application. However, I could not find any example code which uses typical java ...
0
votes
1
answer
2k
views
Document clustering: DBSCAN and optics clustering not giving me any clusters
I tried doing DBSCAN clustering using word2vec weighted tfidf vectors and used different thresholds of epsilon and minpts for DBSCAN. I also tried optics clustering method with different minpts, ...
1
vote
2
answers
105
views
How to store index in ELKI?
I am using ELKI 0.7.2 (master) for running DBSCAN with R* tree on a large data set. Afterwards, I need to store the tree persistently, so that it can be reloaded in memory when new data points are ...
0
votes
1
answer
40
views
How to store data from ELKI gui?
I am struggling to Output the resulting clusters to a .txt or .csv File. Is there a way to write a .csv file like: lon;lat;ClusterId From ELKI GUI?
0
votes
2
answers
179
views
ELKI Kmeans clustering Task failed error for high dimensional data
I have a 60000 documents which i processed in gensim and got a 60000*300 matrix. I exported this as a csv file. When i import this in ELKI environment and run Kmeans clustering, i am getting below ...
2
votes
1
answer
569
views
Parallel DBSCAN in ELKI
Here I can see that there exists class clustering.gdbscan.parallel.ParallelGeneralizedDBSCAN, but when I tried to invoke it, I've got error:
java -cp elki.jar de.lmu.ifi.dbs.elki.application....
0
votes
1
answer
26
views
ELKI: clustering object with Gaussian uncertainty
I am very new to java and using ELKI. I have three dimensional objects have information about their uncertainty ( a multivariate gaussian). I would like to use FDBSCAN to cluster my data. I am ...
0
votes
1
answer
335
views
How to get the original points the cluster contained using ELKI's DBSCAN?
I have 2 questions for the following code:
How to get the 'points' in each cluster in the result?
How could the result contains 3 clusters with one that has size is 0?
import de.lmu.ifi.dbs.elki....
1
vote
1
answer
480
views
ELKI DBSCAN epsilon value issue
i am trying to cluster word vectors using ELKI DBSCAN. I wish to use cosine distance to cluster the word vectors of 300 dimensions. The size of the dataset is 19,000 words (19000*300 size matrix). ...
0
votes
1
answer
136
views
ELKI: How to create Database from several files in java
I try to get data from several csv files. I use ConcatenateFilesDatabaseConnection for db
Database getDbFromFiles(List<File> files) {
ListParameterization params = new ListParameterization()...
2
votes
1
answer
139
views
ELKI DBSCAN Ignore Columns
I have a CSV file with multiple columns where the columns are "lat, lon, item1". I have been able to load the data using the following code:
ListParameterization params = new ListParameterization();
...
0
votes
2
answers
150
views
Implementing distance fucntion for dimensional and multi type data
I'm using ELKI in java for clustering tweet's text in kmeans algorithm. Before clustering, I calculated similarity of tweet's text with tf-idf measure that it used for clustering.
public void ...
0
votes
1
answer
106
views
ELKI: perform min-max normalization before running k-means
I am using one of the k-means implementations provided by ELKI in my Java project.
I would like to run a min-max normalization before actually running the k-means but I cannot understand what is the ...
1
vote
1
answer
82
views
Is there a way to reuse the output of the Optics algorithm for Optics Xi in ELKI?
I'm using elki with the gui and the command line and I want to use the Optics Xi algorithm with the same minPts value but different Xi values multiple times. So as far as I understand Optics Xi it ...
0
votes
0
answers
420
views
Using the Weighted Euclidean Distance Function for DBSCAN in ELKI
I'm experimenting with ELKI (which is awesome, btw) and would like to try the weighted Euclidean distance function as a metric for the DBSCAN algorithm.
First of all, I don't know how it works, ...
0
votes
1
answer
65
views
how to define custome distance function for string in elki?
I'm using elki 0.7 to clustering tweets ( text ,date , author, ...).
in first step I'd like to cluster text of tweets.
I wrote a simple distance function and in the future I want to customized it.
...
0
votes
1
answer
44
views
How to make StaticArrayDatabase from two connections in ELKI?
I have to connection, for two different dataset. And then, i put it into two db.
DatabaseConnection dbc1 = new ArrayAdapterDatabaseConnection(doubles);
DatabaseConnection dbc2 = new ...
0
votes
1
answer
60
views
ELKI cluster extraction HiSC HiCO
I'm comuputing HiCO and HiSC clustering algorithms on my dataset. If I'm not mistaken, the algorithms use different approach to define relevant subspaces for clusters in the 1st step and in the 2nd ...
1
vote
1
answer
121
views
Add index to relation in ELKI
I am trying to add index to relation in db, but don't know is it right?
ListParameterization spatparams = new ListParameterization();
spatparams.addParameter(INDEX_ID, RStarTreeFactory.class);
...
1
vote
1
answer
139
views
How to create db not from file source in ELKI?
Currently,I'm using ELKI to study R-trees. So, i am trying to make database from my set of points. I easily do it with file based database connection:
ListParameterization spatparams = new ...
1
vote
2
answers
141
views
Could not run elki.sh in mac OSX
In order to use ELKI to do a clustering task, I have downloaded the latest complete release package: elki-0.7.1
The README.PDF says to run elki.sh on OSX. However, after I run the elki.sh with ...
3
votes
1
answer
2k
views
ELKI dbscan examples
I want to use dbscan algorithm in ELKI (not on GUI). Please give me some examples including loading data, running algorithm, displaying results? The docs of ELKI don't have any examples.
0
votes
1
answer
128
views
Different runtime of LOF
I am using Elki for running LOF algorithm but every time i run LOF algorithm in Elki, Elki is giving different runtime on same data set.
I am confused why is this happening?
0
votes
1
answer
43
views
Output Graph Change on LOF
I am running local outlier factor on a data set called shuttle downloaded from uci. Every time i am run lof algorithm on shuttle data set with or without decision class but elki is drawing different ...