Questions tagged [featuretools]
Featuretools is a Python library for automated feature engineering on relational datasets using a technique called Deep Feature Synthesis.
216
questions
0
votes
0
answers
19
views
Featuretools group by issue
I have a set of dataframes/entity set for rugby league/sports data: players, teams, venues, games, team_stats and player_stats
players: player_id, player_name
teams: team_id, team_name
games: game_id, ...
0
votes
1
answer
22
views
How to implement Featuretools into my ML Process?
I am exploring the possibility of implementing Featuretools into my pipeline, to be able to create new features from my Df.
Currently I am using a GridSearchCV, with a Pipeline embedded inside it. ...
0
votes
0
answers
24
views
Featuretools deep feature synthesis doesn't generate features
I'm using 3 datasets to create EntitySet using featuretools and use deep feature synthesis to generate additional features:
entity_set = ft.EntitySet("basketball_players")
entity_set....
0
votes
1
answer
37
views
IndexError: Index contains null values when adding dataframe to featuretools EntitySet
I have my dataframe which I want to add to EntitySet:
Unnamed: 0 Year name Pos Age Tm G GS \
24672 24672 2017.0 Troy Williams SF 22.0 TOT 30.0 16.0 ...
0
votes
1
answer
35
views
Create integer unique keys in 3 dataframes for rows with same names to generate automatic features using featuretools
I have three different data frames with basketball players' data.
In all three dataframes there are basketball players' names.
I want to join all three dataframes into one EntitySet to use automatic ...
0
votes
2
answers
33
views
featuretools: got an error "AttributeError: 'DataFrame' object has no attribute 'ww'"
when i try to use featuretools[spark] on pyspark dataframe
my code are bellow:
import featuretools as ft
import pyspark.pandas as ps
from woodwork.logical_types import Double, Integer
ps.set_option(&...
0
votes
1
answer
34
views
How to compare "raw" joins to the output of deep feature synthesis in Featuretools?
Is it possible to get the results someone would get from deep feature synthesis, but without any aggregations?
I have some small datasets, and I want to be able to compare the "processed" ...
0
votes
1
answer
22
views
How do I flatten a featuretools entity set to get wide input format?
I have an entity set with relations defined. Is there a method to get a left joined version of all the data frames in entities as we already have relations?
I can merge the dataframes outside using ...
0
votes
1
answer
57
views
How to apply featuretools to output of featuretools?
I want to create complex features like [(a-b)/c or (a-b)/a]
This can be achieved by running feature tools multiple times so that first one creates features like a-b or a+b or a/b and then next run ...
0
votes
1
answer
47
views
How to create features for multiple datetime columns in featuretools?
Sorry to put three question in one issue.
How to create features for multiple datatime columns?
I got a dataframe with multiple datetime columns, and hoped to create features like TimeSinceFirst, ...
0
votes
1
answer
49
views
when combining features and then aggregating them featuretools returns some variables that don't make sense, how can this be avoided?
I've got a dataset that contains invoices, with a unique identifier, and customers with a unique identifier. Each customer can have 1 or more invoices.
I set up the entity sets as follows:
es = ft....
0
votes
1
answer
68
views
how does featuretools DiffDatetimes work within the dfs?
I've got the following dataset:
where:
customer id represents a unique customer
each customer has multiple invoices
each invoice is marked by a unique identifier (Invoice)
each invoice has multiple ...
0
votes
1
answer
138
views
featuretools: can I create a new features by multiplying 2 existing variables and then obtain transform primitives of that feature?
My data contains the variables Price and Quantity. I'd like to combine them into a new variable containing the total amount of purchase which is the multiple of these 2.
At the back of that, I'd like ...
1
vote
1
answer
161
views
Error trying to apply app_types to logical_types of add_dataframe at once
app_types
{'TARGET': Boolean,
'FLAG_MOBIL': Boolean,
'FLAG_EMP_PHONE': Boolean,
'FLAG_WORK_PHONE': Boolean,
'FLAG_CONT_MOBILE': Boolean,
'FLAG_PHONE': Boolean,
'FLAG_EMAIL': Boolean,
'...
0
votes
0
answers
96
views
define transform primitive "weekend" and define features using data frames
i was trying to create a base line model with only one tranform primitive.
So i'm defining entities and relationships
eg: create entities and relationships. T
trans_primitives = [IsWeekend]
features = ...
0
votes
0
answers
41
views
feature computing using feature tools
I am trying to compute features and define feature matrix on a dataset.
The code is as follows:
def compute_features(features, cutoff_time):
np.random.shuffle(features)
feature_matrix = ft....
1
vote
1
answer
68
views
Use primitive_options on Featuretools to calc feature_matrix
I have a dataset with more than 30.000 rows like the picture below and need to generate some features with the featuretools library.
import pandas as pd
import featuretools as ft
# Read in the full ...
0
votes
2
answers
261
views
How can I get automatical features with dfs, using featuretools, when I have only one dataframe?
I am trying to figure out how Featuretools works and I am testing it on the Housing Prices dataset on Kaggle. Because the dataset is huge, I'll work here with only a set of it.
The dataframe is:
train=...
0
votes
0
answers
49
views
Featuretools support for order / time in Spark EntitySets; is it possible?
https://featuretools.alteryx.com/en/stable/guides/using_spark_entitysets.html#Supported-Primitives mentions:
When creating a feature matrix from a Spark EntitySet, only certain
primitives can be used....
0
votes
1
answer
56
views
How can I use get_valid_primitives when I have only one dataframe in Featuretools?
I am trying to figure out how Featuretools works and I am testing it on the Housing Prices dataset on Kaggle. Because the dataset is huge, I'll work here with only a set of it.
The dataframe is:
train=...
0
votes
1
answer
58
views
there is a question about remove_highly_correlated_features
I'm working on the featuretools package.I have a question about functions "remove_highly_correlated_features".In the documentation:"We make the assumption that, for a pair of features, ...
0
votes
1
answer
54
views
How to implement a function containing imputation methods to aggregation primitives in featuretools?
I'd like to use mean/median/mode imputation methods for null values in a dataset.
The output is supposed to be a table with aggregated values already. I just have really no idea on how to do it..
0
votes
1
answer
35
views
Load features created by custom primitives
I created some features base on custom primitives with help of featuretools and saved them into memory. Then I want load them with featuretools.load_features function. But I get the error RuntimeError:...
0
votes
1
answer
241
views
Featuretools - unable to add relationship in Entityset
I'm writing a notebook using this data from Kaggle. Here's a screenshot of the two tables just to show we have ID columns in both.
Here's my code when trying to set up the Entity Set and add a ...
0
votes
1
answer
121
views
Featuretools /woodwork :'Entity' object has no attribute 'ww'
featuretools==0.27.1
woodwork==0.10.0
Anyone has ideas?
es_1 = ft.demo.load_mock_customer(return_entityset=True)
es_1['products'].ww
AttributeError Traceback (most recent ...
0
votes
1
answer
70
views
FeatureTools deal with aggregation like count(distinct day())
I'm dealing with data by featuretools, and after checking the result. I find out that maybe count distinct day() could be better than count(). But I'm new to ft, and couldn't find a way to get these ...
0
votes
0
answers
149
views
How to use Featuretools to create features on new test data?
I have used Featuretools to generate features for a single table using a script like this:
es = ft.EntitySet(id = 'data')
es = es.entity_from_dataframe(entity_id = 'df', dataframe = X,
...
0
votes
1
answer
797
views
ModuleNotFoundError: No module named 'featuretools' even though I have installed featuretools
I keep getting the error ModuleNotFoundError: No module named 'featuretools' in Jupyter Notebook. However, it looks like it has been successfully installed when I install it in the terminal. I have ...
-1
votes
1
answer
87
views
The logics of the creation of aggregated features with featuretools
I have a dataset what contains several columns, including date, instance_id, numerical_x and categorical_y. I use featuretools package for feature generation as it has powerful ability to take time ...
1
vote
1
answer
67
views
Enable/force featuretools to use 2 or more columns to group by
How to enable or force featuretools to create featuretools groupby features using 2 or more columns as group bys.
For example I have columns x, y, z
how to set groupby_primitives_options or something ...
0
votes
2
answers
83
views
Proper way to pass cutoff_time to dfs in featuretools 1.0.0
Recently I've updated featuretools to v1.0.0 and faced the following issue. I have instances that vary within time and I want to build time dependent features for them. Besides, I want to save some ...
0
votes
0
answers
203
views
Index names must be exactly matched currently
I am trying to add koalas dataframe in an entitySet. Here is the code for it
subset_kdf_fp_eta_gt_prd.spark.print_schema()
root
|-- booking_code: string (nullable = true)
|-- order_id: string (...
5
votes
2
answers
3k
views
[featuretools]'EntitySet' object has no attribute 'entity_from_dataframe'
I tried to learn featuretools following documentation from featuretools.com.
A error came up:
AttributeError: 'EntitySet' object has no attribute 'entity_from_dataframe'
Could you help me?
Thank you.
...
0
votes
1
answer
357
views
Unable to add relationship in featuretools entity set
New to feature tools, getting this error while creating entity
Unable to add relationship because child column 'order_id' in 'orders' is also its index
I suspect that featuretools expect one to many ...
0
votes
1
answer
93
views
Parallelizing feature tools dfs
I tried a similar code to this snippet
ft.dfs(entityset = es,
target_entity = ...,
n_jobs=-1,) # or n_jobs=40
But it doesn't seem to work on a machine with 40 threads:
S CPU% MEM% ...
1
vote
1
answer
282
views
Features Created by FeatureTools Build Inconsistent Models
I have an imbalanced dataset which has 200 million data from class 0 and 8000 data from class 1. I followed two different approaches to build a model.
Randomly sample a new dataset which has a ratio ...
0
votes
1
answer
134
views
Using multiple Ids in featuretools
I have a dataset which I would like to conduct automatic feature engineering on. However it is time series based, so in order to make it work I have to use 2 things as ids, the object id and the date.
...
0
votes
1
answer
100
views
Applying Featuretools output to another dataframe
I have a dataframe which the target features, which looks like this:
x x1 y
1 2 3
2 3 4
Now I use feautretools to automatically do feature engineering, using this line of code:
es = ft.EntitySet(id = ...
0
votes
1
answer
115
views
Is it possible to calculate a feature matrix only for test data?
I have more than 100,000 rows of training data with timestamps and would like to calculate a feature matrix for new test data, of which there are only 10 rows. Some of the features in the test data ...
0
votes
1
answer
87
views
Regarding featuretools, the rank results are wrong
Using Featuretools, I want to convert the value of a certain feature to rank.
This will be the exact question. If anyone can help me, please answer.
First, the following code uses the rank function of ...
0
votes
1
answer
182
views
in featuretools, How to Custom Primitives of 2 columns?
I created Custom Primitives like below.
class Correlate(TransformPrimitive):
name = 'correlate'
input_types = [Numeric,Numeric]
return_type = Numeric
commutative = True
compatibility = [Library.PANDAS,...
0
votes
1
answer
67
views
Featuretools documentation of specifying primitive options is wrong?
The documentation says:
Specifying for Individual Primitives
Options for individual primitives or groups of primitives are set by the primitive_options parameter of DFS. This parameter maps any ...
0
votes
1
answer
109
views
In featuretools, How to control the application of where_primitives?
In featuretools we have various primitive application control mechanisms to custom apply the primitives to select entities and columns.
They are very neatly documented here
The ignore_entities and ...
1
vote
0
answers
197
views
Featuretools taking too long to build features without using CPU cores
I'm using featuretools Deep Feature Sintesys to build features for a dataset of 40k rows and 200 columns. I choose about 40 transformation primitivies, as you can see in the code bellow:
...
0
votes
1
answer
83
views
Featuretools - RollingSum
I am trying to create the custom primitive rolling-sum features using featuretools and below is the code:-
class RollingSumOnDatetime(TransformPrimitive):
"""Calculates the rolling ...
0
votes
1
answer
389
views
Featuretools: Generate rolling sum, mean etc. using Pandas 'rolling' but with an offset in days
I am trying to create a custom TransformPrimitive in Featuretools to calculate rolling statistics like the rolling sum or mean.
This article explains well how to go about such task using Pandas. It ...
0
votes
1
answer
102
views
Can featuretools be used on a vaex dataframe?
I'm trying to play with automated feature engineering - I've got it to work on raw dataframes but I'm not sure to do it on out of memory dataframes such as vaex. My purpose is to find a way to use ...
0
votes
2
answers
303
views
Custom Multiple Input Primitive Bug returns "TypeError: issubclass() arg 1 must be a class"
I am using Featuretools library to try to generate custom features involving customer transactions. I tested the function and it returns the answer so I am not sure why I am getting this error.
I ...
1
vote
1
answer
112
views
How to get trans_primitives of highest entity in featuretools?
In the classic mock customer dataset example in featuretools, if I have to derive trans_primitives like month, day, year etc. of transaction_time attribute of transactions entity. How do I do that?
...
1
vote
1
answer
131
views
How to implement custom naming for multioutput primitives in FeatureTools
As of version v0.12.0, FeatureTools allows you to assign custom names to multi-output primitives: https://github.com/alteryx/featuretools/pull/794. By default, the when you define custom multi-output ...