Questions tagged [featuretools]

Featuretools is a Python library for automated feature engineering on relational datasets using a technique called Deep Feature Synthesis.

Filter by
Sorted by
Tagged with
0 votes
0 answers
19 views

Featuretools group by issue

I have a set of dataframes/entity set for rugby league/sports data: players, teams, venues, games, team_stats and player_stats players: player_id, player_name teams: team_id, team_name games: game_id, ...
0 votes
1 answer
22 views

How to implement Featuretools into my ML Process?

I am exploring the possibility of implementing Featuretools into my pipeline, to be able to create new features from my Df. Currently I am using a GridSearchCV, with a Pipeline embedded inside it. ...
0 votes
0 answers
24 views

Featuretools deep feature synthesis doesn't generate features

I'm using 3 datasets to create EntitySet using featuretools and use deep feature synthesis to generate additional features: entity_set = ft.EntitySet("basketball_players") entity_set....
0 votes
1 answer
37 views

IndexError: Index contains null values when adding dataframe to featuretools EntitySet

I have my dataframe which I want to add to EntitySet: Unnamed: 0 Year name Pos Age Tm G GS \ 24672 24672 2017.0 Troy Williams SF 22.0 TOT 30.0 16.0 ...
0 votes
1 answer
35 views

Create integer unique keys in 3 dataframes for rows with same names to generate automatic features using featuretools

I have three different data frames with basketball players' data. In all three dataframes there are basketball players' names. I want to join all three dataframes into one EntitySet to use automatic ...
0 votes
2 answers
33 views

featuretools: got an error "AttributeError: 'DataFrame' object has no attribute 'ww'"

when i try to use featuretools[spark] on pyspark dataframe my code are bellow: import featuretools as ft import pyspark.pandas as ps from woodwork.logical_types import Double, Integer ps.set_option(&...
  • 9
0 votes
1 answer
34 views

How to compare "raw" joins to the output of deep feature synthesis in Featuretools?

Is it possible to get the results someone would get from deep feature synthesis, but without any aggregations? I have some small datasets, and I want to be able to compare the "processed" ...
  • 103
0 votes
1 answer
22 views

How do I flatten a featuretools entity set to get wide input format?

I have an entity set with relations defined. Is there a method to get a left joined version of all the data frames in entities as we already have relations? I can merge the dataframes outside using ...
0 votes
1 answer
57 views

How to apply featuretools to output of featuretools?

I want to create complex features like [(a-b)/c or (a-b)/a] This can be achieved by running feature tools multiple times so that first one creates features like a-b or a+b or a/b and then next run ...
  • 500
0 votes
1 answer
47 views

How to create features for multiple datetime columns in featuretools?

Sorry to put three question in one issue. How to create features for multiple datatime columns? I got a dataframe with multiple datetime columns, and hoped to create features like TimeSinceFirst, ...
  • 454
0 votes
1 answer
49 views

when combining features and then aggregating them featuretools returns some variables that don't make sense, how can this be avoided?

I've got a dataset that contains invoices, with a unique identifier, and customers with a unique identifier. Each customer can have 1 or more invoices. I set up the entity sets as follows: es = ft....
0 votes
1 answer
68 views

how does featuretools DiffDatetimes work within the dfs?

I've got the following dataset: where: customer id represents a unique customer each customer has multiple invoices each invoice is marked by a unique identifier (Invoice) each invoice has multiple ...
0 votes
1 answer
138 views

featuretools: can I create a new features by multiplying 2 existing variables and then obtain transform primitives of that feature?

My data contains the variables Price and Quantity. I'd like to combine them into a new variable containing the total amount of purchase which is the multiple of these 2. At the back of that, I'd like ...
1 vote
1 answer
161 views

Error trying to apply app_types to logical_types of add_dataframe at once

app_types {'TARGET': Boolean, 'FLAG_MOBIL': Boolean, 'FLAG_EMP_PHONE': Boolean, 'FLAG_WORK_PHONE': Boolean, 'FLAG_CONT_MOBILE': Boolean, 'FLAG_PHONE': Boolean, 'FLAG_EMAIL': Boolean, '...
0 votes
0 answers
96 views

define transform primitive "weekend" and define features using data frames

i was trying to create a base line model with only one tranform primitive. So i'm defining entities and relationships eg: create entities and relationships. T trans_primitives = [IsWeekend] features = ...
0 votes
0 answers
41 views

feature computing using feature tools

I am trying to compute features and define feature matrix on a dataset. The code is as follows: def compute_features(features, cutoff_time): np.random.shuffle(features) feature_matrix = ft....
1 vote
1 answer
68 views

Use primitive_options on Featuretools to calc feature_matrix

I have a dataset with more than 30.000 rows like the picture below and need to generate some features with the featuretools library. import pandas as pd import featuretools as ft # Read in the full ...
  • 21
0 votes
2 answers
261 views

How can I get automatical features with dfs, using featuretools, when I have only one dataframe?

I am trying to figure out how Featuretools works and I am testing it on the Housing Prices dataset on Kaggle. Because the dataset is huge, I'll work here with only a set of it. The dataframe is: train=...
0 votes
0 answers
49 views

Featuretools support for order / time in Spark EntitySets; is it possible?

https://featuretools.alteryx.com/en/stable/guides/using_spark_entitysets.html#Supported-Primitives mentions: When creating a feature matrix from a Spark EntitySet, only certain primitives can be used....
  • 5,260
0 votes
1 answer
56 views

How can I use get_valid_primitives when I have only one dataframe in Featuretools?

I am trying to figure out how Featuretools works and I am testing it on the Housing Prices dataset on Kaggle. Because the dataset is huge, I'll work here with only a set of it. The dataframe is: train=...
0 votes
1 answer
58 views

there is a question about remove_highly_correlated_features

I'm working on the featuretools package.I have a question about functions "remove_highly_correlated_features".In the documentation:"We make the assumption that, for a pair of features, ...
  • 1
0 votes
1 answer
54 views

How to implement a function containing imputation methods to aggregation primitives in featuretools?

I'd like to use mean/median/mode imputation methods for null values in a dataset. The output is supposed to be a table with aggregated values already. I just have really no idea on how to do it..
0 votes
1 answer
35 views

Load features created by custom primitives

I created some features base on custom primitives with help of featuretools and saved them into memory. Then I want load them with featuretools.load_features function. But I get the error RuntimeError:...
0 votes
1 answer
241 views

Featuretools - unable to add relationship in Entityset

I'm writing a notebook using this data from Kaggle. Here's a screenshot of the two tables just to show we have ID columns in both. Here's my code when trying to set up the Entity Set and add a ...
0 votes
1 answer
121 views

Featuretools /woodwork :'Entity' object has no attribute 'ww'

featuretools==0.27.1 woodwork==0.10.0 Anyone has ideas? es_1 = ft.demo.load_mock_customer(return_entityset=True) es_1['products'].ww AttributeError Traceback (most recent ...
0 votes
1 answer
70 views

FeatureTools deal with aggregation like count(distinct day())

I'm dealing with data by featuretools, and after checking the result. I find out that maybe count distinct day() could be better than count(). But I'm new to ft, and couldn't find a way to get these ...
0 votes
0 answers
149 views

How to use Featuretools to create features on new test data?

I have used Featuretools to generate features for a single table using a script like this: es = ft.EntitySet(id = 'data') es = es.entity_from_dataframe(entity_id = 'df', dataframe = X, ...
  • 510
0 votes
1 answer
797 views

ModuleNotFoundError: No module named 'featuretools' even though I have installed featuretools

I keep getting the error ModuleNotFoundError: No module named 'featuretools' in Jupyter Notebook. However, it looks like it has been successfully installed when I install it in the terminal. I have ...
-1 votes
1 answer
87 views

The logics of the creation of aggregated features with featuretools

I have a dataset what contains several columns, including date, instance_id, numerical_x and categorical_y. I use featuretools package for feature generation as it has powerful ability to take time ...
1 vote
1 answer
67 views

Enable/force featuretools to use 2 or more columns to group by

How to enable or force featuretools to create featuretools groupby features using 2 or more columns as group bys. For example I have columns x, y, z how to set groupby_primitives_options or something ...
0 votes
2 answers
83 views

Proper way to pass cutoff_time to dfs in featuretools 1.0.0

Recently I've updated featuretools to v1.0.0 and faced the following issue. I have instances that vary within time and I want to build time dependent features for them. Besides, I want to save some ...
0 votes
0 answers
203 views

Index names must be exactly matched currently

I am trying to add koalas dataframe in an entitySet. Here is the code for it subset_kdf_fp_eta_gt_prd.spark.print_schema() root |-- booking_code: string (nullable = true) |-- order_id: string (...
5 votes
2 answers
3k views

[featuretools]'EntitySet' object has no attribute 'entity_from_dataframe'

I tried to learn featuretools following documentation from featuretools.com. A error came up: AttributeError: 'EntitySet' object has no attribute 'entity_from_dataframe' Could you help me? Thank you. ...
  • 113
0 votes
1 answer
357 views

Unable to add relationship in featuretools entity set

New to feature tools, getting this error while creating entity Unable to add relationship because child column 'order_id' in 'orders' is also its index I suspect that featuretools expect one to many ...
0 votes
1 answer
93 views

Parallelizing feature tools dfs

I tried a similar code to this snippet ft.dfs(entityset = es, target_entity = ..., n_jobs=-1,) # or n_jobs=40 But it doesn't seem to work on a machine with 40 threads: S CPU% MEM% ...
1 vote
1 answer
282 views

Features Created by FeatureTools Build Inconsistent Models

I have an imbalanced dataset which has 200 million data from class 0 and 8000 data from class 1. I followed two different approaches to build a model. Randomly sample a new dataset which has a ratio ...
  • 63
0 votes
1 answer
134 views

Using multiple Ids in featuretools

I have a dataset which I would like to conduct automatic feature engineering on. However it is time series based, so in order to make it work I have to use 2 things as ids, the object id and the date. ...
0 votes
1 answer
100 views

Applying Featuretools output to another dataframe

I have a dataframe which the target features, which looks like this: x x1 y 1 2 3 2 3 4 Now I use feautretools to automatically do feature engineering, using this line of code: es = ft.EntitySet(id = ...
0 votes
1 answer
115 views

Is it possible to calculate a feature matrix only for test data?

I have more than 100,000 rows of training data with timestamps and would like to calculate a feature matrix for new test data, of which there are only 10 rows. Some of the features in the test data ...
  • 27
0 votes
1 answer
87 views

Regarding featuretools, the rank results are wrong

Using Featuretools, I want to convert the value of a certain feature to rank. This will be the exact question. If anyone can help me, please answer. First, the following code uses the rank function of ...
0 votes
1 answer
182 views

in featuretools, How to Custom Primitives of 2 columns?

I created Custom Primitives like below. class Correlate(TransformPrimitive): name = 'correlate' input_types = [Numeric,Numeric] return_type = Numeric commutative = True compatibility = [Library.PANDAS,...
0 votes
1 answer
67 views

Featuretools documentation of specifying primitive options is wrong?

The documentation says: Specifying for Individual Primitives Options for individual primitives or groups of primitives are set by the primitive_options parameter of DFS. This parameter maps any ...
0 votes
1 answer
109 views

In featuretools, How to control the application of where_primitives?

In featuretools we have various primitive application control mechanisms to custom apply the primitives to select entities and columns. They are very neatly documented here The ignore_entities and ...
1 vote
0 answers
197 views

Featuretools taking too long to build features without using CPU cores

I'm using featuretools Deep Feature Sintesys to build features for a dataset of 40k rows and 200 columns. I choose about 40 transformation primitivies, as you can see in the code bellow: ...
0 votes
1 answer
83 views

Featuretools - RollingSum

I am trying to create the custom primitive rolling-sum features using featuretools and below is the code:- class RollingSumOnDatetime(TransformPrimitive): """Calculates the rolling ...
0 votes
1 answer
389 views

Featuretools: Generate rolling sum, mean etc. using Pandas 'rolling' but with an offset in days

I am trying to create a custom TransformPrimitive in Featuretools to calculate rolling statistics like the rolling sum or mean. This article explains well how to go about such task using Pandas. It ...
  • 83
0 votes
1 answer
102 views

Can featuretools be used on a vaex dataframe?

I'm trying to play with automated feature engineering - I've got it to work on raw dataframes but I'm not sure to do it on out of memory dataframes such as vaex. My purpose is to find a way to use ...
  • 24.5k
0 votes
2 answers
303 views

Custom Multiple Input Primitive Bug returns "TypeError: issubclass() arg 1 must be a class"

I am using Featuretools library to try to generate custom features involving customer transactions. I tested the function and it returns the answer so I am not sure why I am getting this error. I ...
1 vote
1 answer
112 views

How to get trans_primitives of highest entity in featuretools?

In the classic mock customer dataset example in featuretools, if I have to derive trans_primitives like month, day, year etc. of transaction_time attribute of transactions entity. How do I do that? ...
1 vote
1 answer
131 views

How to implement custom naming for multioutput primitives in FeatureTools

As of version v0.12.0, FeatureTools allows you to assign custom names to multi-output primitives: https://github.com/alteryx/featuretools/pull/794. By default, the when you define custom multi-output ...

1
2 3 4 5