Questions tagged [mahout]
Apache Mahout open source scalable machine learning project
1,171
questions
0
votes
0
answers
32
views
Running Mahout in Hadoop Cluster - java.lang.ClassNotFoundException
I am trying to run the mahout code in the Hadoop cluster, it is throwing the below error.
Error: java.lang.ClassNotFoundException:
org.apache.mahout.cf.taste.model.DataModel at
java.net....
1
vote
0
answers
34
views
Why does the result of ItemSimilarityJob lack some similarities of itemId-pair?
Given that I have the following ratings.csv
userId,itemId,rating
1,1,1
1,2,2
1,3,3
2,2,4
2,3,2
2,5,4
2,6,5
3,1,5
3,3,1
3,6,2
4,4,4
Using org.apache.mahout.cf.taste.hadoop.item.RecommenderJob, we have
...
0
votes
1
answer
931
views
hadoop "Can not create a Path from an empty string"
I am a beginner of hadoop.
I have been getting error as following.
Exception in thread "main" java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org....
0
votes
0
answers
337
views
How to resolve job_1634335400729_0001 failed with state FAILED due to: Application application_1634335400729_0001 failed 2 times error on hadoop
whenever I try to splitData using
mahout splitDataset --input /mini_datasets1/wimmer-mini_obesity_data2.csv --output mini_datasets1/wimmer-mini_obesity_data2split --trainingPercentage 0.7 --...
1
vote
1
answer
107
views
Does Hadoop 3 support Mahout?
I was wondering if any Mahout version has been confirmed to work properly with any version of Hadoop 3.x.
It looks like both Cloudera's and Amazon's Hadoop distribution removed Mahout when they went ...
0
votes
2
answers
206
views
Off-line clustering using solr?
I want to cluster my indexed data in solr. Each solr document contains the following fields : id, title, url.
I have read solr 7.7 docs and the clustering algorithm mentioned there is applied only to ...
0
votes
1
answer
175
views
Apache Mahout Vs Apache Spark in local mode with nutch data
I already have nutch/solr application in single mode. I'm spouse to try integrating Mahout or spark to achieve kinda of personlized results. But I'm still a lot far from that point.
With lack of ...
0
votes
0
answers
17
views
Linux pointing to wrong version of Mahout
I have an issue where I'm attempting to use Mahout 0.7 but Linux defaults to using Mahout 0.9.
I have mahout 0.7 at the following location: /home/cloudera/mahout-distribution-0.7
And I've updated my ...
0
votes
0
answers
42
views
Mahout custom data
I need to make a recommendation system using mahout. My data has the following data pieces:
userID -> The numerical id of the user
foodID -> Contains the numerical id of the food (for example ketchup'...
1
vote
2
answers
302
views
Errors caused by adding Mahout Dependency to Gradle
I am trying to run a hadoop job using gradle to build my project and when I add the mahout dependencies
apply plugin: 'java'
repositories {
mavenCentral()
}
dependencies {
compile group: '...
0
votes
1
answer
97
views
MojoExecution Exception in mahout library
I am trying to use Mahout Library on top of my Hadoop cluster, I have installed all pre-requisites like Hadoop, java and maven.
I have downloaded Mahout library and when i am trying to use 'mvn ...
3
votes
0
answers
222
views
Error: Could not find or load main class org.apache.mahout.driver
I am trying to setup standalone Mahout on local machine where I can run spark-itemsimilarity command on it. I get following error :
$ ./mahout
Adding lib/ to CLASSPATH
MAHOUT_LOCAL is set, running ...
1
vote
1
answer
42
views
When I run k-Means by Mahout,always show this tip
code:
hadoop jar /home/xnz/local/opt/apache-mahout-distribution-0.13.0/mahout-integration-0.13.0.jar \
org.apache.mahout.clustering.conversion.InputDriver \
-i /user/root/ -o /user/root/input/...
0
votes
1
answer
68
views
How to implement a trending recommender in mahout
I am using mahout core to implement several recommender functions. Among others, I want to implement a "trending products" recommendation function.
Usually I would use something like Z-score, but I ...
1
vote
1
answer
128
views
What is the right way to increment mahout recommender model?
I have a stream of user-item pairs, hold a block based on last 6M records and update it each minute. I don't like that between these rebuilds some important data might be unused. For example new user ...
5
votes
1
answer
250
views
Can apache mahout ALS work without hadoop?
I tried using ParallelALSFactorizationJob, but it crashes here:
Exception in thread "main" java.lang.NullPointerException
at java.lang.ProcessBuilder.start(ProcessBuilder.java:1012)
at org....
1
vote
1
answer
450
views
Integrate Apache Mahout with ElasticSearch in Spring Boot
I have a Spring Boot application integrated with ElasticSearch.
When i am trying to add Apache Mahout as a maven dependency, the application is no longer running with this error:
Invocation of init ...
0
votes
1
answer
32
views
Mahout clustering without sequence files?
Is there any way to write a toy Mahout example that doesn't use sequence files but just a collection of vectors?
I am trying to learn about distance measures and want to do a helloworld clustering ...
0
votes
1
answer
34
views
Mahout clustering - all text vectors in single cluster - why?
I've run the following example:
https://github.com/technobium/mahout-clustering/blob/master/src/main/java/com/technobium/ClusteringDemo.java#L64
Document 1 -> John saw a red car.
Document 2 -> ...
0
votes
1
answer
74
views
Mahout 0.13.0 spark-shell examples fails with "no jniViennaCL in java.library.path"
I'm Trying to make Mahout 0.13.0 works with spark 1.6.3,
I already have spark 1.6.3 and Hadoop 2.7 working.
I download the last build from the homepage mahout_download.
Unpackage on /opt/mahout.
try ...
1
vote
1
answer
282
views
spark-submit with Mahout error on cluster mode (Scala/java)
I'm trying to build a basic recomender with Spark and Mahout on Scala.
I use the follow mahout repo to compile mahout with scala 2.11 and spark 2.1.2 mahout_fork
To execute my code I use spark-submit ...
5
votes
4
answers
20k
views
How to fix the error: test source folder 'src/test/java' in project must have an output folder that is not also used for main source"?
I have installed mahout and I have imported the existing maven project apache-mahout-distribution-0.12.2 to Eclipse IDE for Java Developers and can not build and I couldn't fix these problems. Please ...
1
vote
1
answer
80
views
Install Mahout on Mac OS High Sierra 10.13.5: Error on mahout-native-viennacl-omp_2.10
I've been working on installing Mahout on my Mac, and have run into an error on the goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec. Seems to be related to OpenMP, which I've seen has some issues ...
3
votes
1
answer
68
views
How to make mahout kmeans function clusterDumper.printClusters() print the result to a file
I am using Mahout 0.9. I ran kmeans and it gets some result in my HDFS, such as clusteredPoints, clusters-2-final and so on. I know they are sequence file and not easy to read.
However, in Java code, ...
0
votes
1
answer
84
views
Is parameter T1 really necessary in Canopy Clustering?
Since a point falls into range(t2, t1) will not be removed.
And the only two reasons we remove a point are:
1. Construct a new canopy with this point.
2. This point fall into range(0, t2) of another ...
0
votes
1
answer
84
views
Mahout: where can I find the java class executed by a bash shell script?
I'm tring to write a java program using some functions from Mahout. I know that I can execute some Mahout functions with command line but I also want to know where I can find those functions in the ....
0
votes
1
answer
101
views
hadoop mahout:run org.apache.classifier.df.mapreduce.TestForest error
I'm new to Mahout and Random-Forest.I wanna classify my dataset and have built the random-forest on my three virtual Hadoop nodes.
As we know,first of all,I made the descriptor(/des.info).And I built ...
0
votes
1
answer
2k
views
getting error whle running hive : org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.RuntimeException hive error and many more
my .bashrc
getting error while running hive:
org.apache.hadoop.hive.ql.metadata.HiveException:
java.lang.RuntimeException hive error and many more
Java
export JAVA_HOME=/usr/lib/jvm/java-...
0
votes
1
answer
502
views
Content based recommender engine using mahout on eclipse
Are there any step by step tutorials for making a content based recommender system with Mahout on eclipse/java?
Ive tried wokring with Mahout and was able to make a collaborative system but i want to ...
1
vote
1
answer
85
views
TFIDF using Apache Mahout have "Job failed!" when app run
I want to run simple app using Apache Mahout from http://technobium.com/tfidf-explained-using-apache-mahout/. But! When app running, i have some exception:
Exception in thread "main" java.lang....
0
votes
1
answer
34
views
error while dumping sequence files from hdfs
I want to dump my sequence files from hdfs to local and i tried with seqdumper.
How to resolve following error?
I am using mahout 0.12.0 version.
I got the same error with clusterdump as well.
0
votes
1
answer
85
views
getting error while running this command mahout trainnb -i path_to/train-vectors -el -li path_to/labelindex -o path_to/model -ow -c
see the attached image.I am using mahout locally. I have converted sequence file to sparse vectors and I have also split the set into two sets: a training set and a testing set:
mahout split -i ...
0
votes
1
answer
48
views
Mahout seq2sparse is giving IllegalArgumentException
I have set MAHOUT_LOCAL=TRUE
I did use the local way of running mahout by using file://path_of_file, still did not work for me );
2
votes
2
answers
188
views
Computing preference values in Apache Mahout
I am trying to learn Apache mahout, very new to this topic. I want to implement user-based recommender. For this, after exploring on the internet I have found some samples like below,
public static ...
0
votes
0
answers
376
views
Integrating Mahout project with Intellij
How do I integrate Mahout with my intellij IDE.
I have downloaded the "apache-mahout-distribution-0.13.0" from http://mahout.apache.org/.
I am finding it difficult to integrate this for my machine ...
1
vote
1
answer
316
views
Preferred recommendation system
I am implementing a employee planning solution where staff can have their preferred work times and this system can also recommend the best time a staff should work.
To provide recommendations to a ...
2
votes
0
answers
141
views
SequenceFile.Writer leads to NullPointerException
Hi I am trying to create a simple sequencefile with mahout libraries using the bellow code. While running the code I am getting NullPointerException after creating a empty file,
public class ...
0
votes
1
answer
52
views
Does Mahout's XmlInputFormat handle gzip compressed files without rewriting?
Can Mahout's XmlInputFormat handle gzipped data without overriding any of its methods? I've been attempting to parse wikipedia xml data that is gzipped, and so far have been unsuccessful.
I've heard ...
1
vote
0
answers
74
views
How should I pass clustered dataset to Apache Mahout recommender?
I am working on Movielens dataset and I want to create a user based recommender system which is based on k-means clustering. I have created the clustered dataset using Python and now I want to use it ...
2
votes
1
answer
587
views
How to implement Mahout spark-similarity algorithm for recommendation
I have been struggling to understand how to implement user/item based recommendation using Mahout-Samsara, but not able to understand how to use it. I have very basic knowledge of Mahout Map Reduce ...
2
votes
0
answers
218
views
Running basic examples in Mahout with Maven
I'm trying to run some basic examples in Mahout, but most of the tutorials and sample code I could find comes from much earlier versions and don't work. I want to do this with Maven and I don't have ...
1
vote
1
answer
1k
views
The Mahalanobis distance between a point and the mean vector is always the same
I‘m trying to perform some data cleansing algorithm recently. When I try to calculate the mahalanobis distance between points in the data set and the mean vector, it seems the same.
For example, I ...
1
vote
2
answers
1k
views
How to write recommendation on Mahout Spark
Mahout 0.13.0 / java 8
I am completely new in Mahout and trying to understand how to implement recommendation engine using Mahout. So far i know ..
Mahout provides 3 types of filtering -
...
0
votes
1
answer
386
views
Running Kmeans Clustering example with Maven (Mahout in Action)
I'm considering the same example as in How to run examples in mahout in action book, but I want to use Maven to run it. It builds fine with
> mvn clean -DskipTests package
but when I try to run ...
1
vote
3
answers
321
views
Unable to add class: org.apache.mahout.classifier.df.mapreduce.BuildForest in Mahout.0.13
1)When I run this Random Forest example
$MAHOUT_HOME/bin/mahout org.apache.mahout.classifier.df.mapreduce.BuildForest -Dmapred.max.split.size=1874231 -d inputMahoutExamples/RandomForest/rfsplit/...
2
votes
1
answer
154
views
Example of using Cassandra data model for Apache Mahout
I am looking for example of using "CassandraDataModel" for Mahout. Also what tables are needed and how to import data into those tables from CSV files
0
votes
0
answers
60
views
Mahout: Training of generated vector is throwing exception
I am having a Mahout 0.13.0 job that is running on Hadoop 2.7.3(using AWS). When I am trying to train generated vector, it is throwing below exception:
Container killed by the ApplicationMaster.
...
0
votes
1
answer
32
views
FileNotFoundException when running sample test SparseSparseDrmTimer with Mahout
I followed https://github.com/apache/mahout#building-from-source instructions. Everything went well. Scala shell starts with Mahout.
Now I am trying to perform sample test described in article:
...
0
votes
2
answers
2k
views
How to install and use Mahout for windows?
I am working in Spark in windows. I have successfully set up spark and environmental variables in windows and my programs run in Scala IDE with no issues. Now I need to use Mahout library functions ...
0
votes
0
answers
301
views
Error when running mahout spark-itemsimilarity - ClassNotFoundException: scopt.OptionParser
https://mahout.apache.org/users/algorithms/intro-cooccurrence-spark.html
Using this reference, I was trying mahout spark-itemsimilarity but getting an error when running the following command
...