Questions tagged [data-science]

Implementation questions about data science. Data science concerns extracting knowledge or insights from data, in whatever shape or form. It can contain predictive analytics and usually takes a lot of data wrangling. General questions about data science should be posted to their respective communities.

Filter by
Sorted by
Tagged with
-3 votes
0 answers
28 views

i have an error when trying to run the decision tree model

i have a school ml group project and it's about reproducing the results of the a study on intrusion detection system on NSL-KDD dataset and i got the classification part i was tryin to empliment the ...
tasnim nefzi's user avatar
-2 votes
0 answers
12 views

How can I incorporate a science degree in the analytical field? [closed]

I have an undergraduate degree in Human biology and want to incorporate that with an analytical masters degree, but do not know how I can do that or what field would I try targeting. I want to learn ...
rmendoza907's user avatar
0 votes
0 answers
6 views

Using Imitation library to do behavioral clonning in reinforcement learning

for some context: The action represents a price offered for an item, and the reward is calculated as the difference between the target available seats and the actual available seats imagine a bus ...
EZEQUIAS ECHENIQUE's user avatar
-2 votes
0 answers
13 views

Idea to build suggestion model using supervised or unsupervised? [closed]

Assume we start on one huge area and want to build a model to suggest whether how much for each point of latlon recommended to be placed with new signal transmitter. 1st step : create all possible ...
nomansland_1947's user avatar
-2 votes
0 answers
17 views

I need to make an ML-model that evaluates employee attrition rate based on his corporate email usage data [closed]

This model input is metadata of email usage for each employee such as number of outcoming emails, number of emails received, etc. and content of each email. The output is percentage chance of ...
Danila's user avatar
  • 7
1 vote
2 answers
63 views

How do use pivot a table and cumulate them?

I have a dataset which has two destination and the distance between them! city1 city2 distance 101 102 56 102 103 34 103 104 6 104 105 15 I want to prepare a table which will have the cumulative ...
Kishore Kumar's user avatar
-2 votes
0 answers
28 views

How do you go about diagnosing an incorrect dataset that you don't own, and how to know if you're processing it wrong or just bad data? [closed]

I am having some trouble with the IMDB datasets that can be found [here](https://datasets.imdbws.com/). I'm using these on a project, but running into some issues with specifically the movie title ...
Evelyn's user avatar
  • 1
-2 votes
0 answers
21 views

How to detect credit card fraud using WEKA?? HELP NEEDED [closed]

I have this assignment for my comp sci module. I need to use WEKA to detect which users are likely to default on their credit card due payments. I am new to WEKA, so struggling a bit. I have been ...
Paul Carmody's user avatar
-3 votes
0 answers
18 views

How to take the most frequent value of n_neighbors instead of mean?

I'm currently working with categorical data and i do Label Encoding, after doing encoding, i want to impute the NaN values using KNNImputer. I want to consider five neighbors, but i just want to take ...
Fathur's user avatar
  • 1
-2 votes
0 answers
31 views

How do I view all the parameters of my model in jupyter notebook

enter image description here I have tried lot of methods to view all the content in jupyter's output but I am unable to view all the parameters in this model I am a beginner pls help. I tried pd....
Kartikey Lohani's user avatar
0 votes
0 answers
15 views

How to improve rotation in Procrustes Analysis

I wonder if it's possible to improve rotation in Procrustes Analysis? For example, If I give you this example. Assume that we have data like this: % Data X = [linspace(0, 10)', linspace(10, 10)'; ...
euraad's user avatar
  • 2,623
0 votes
1 answer
22 views

How can i work with different tags for the same item while scraping a web?

I need to scrape this page (https://www.cotodigital3.com.ar/sitios/cdigi/browse/catalogo-textil-indumentaria-ni%C3%B1os-remeras/_/N-1vjzjgf). I will be changing the link based on the filters I need. ...
nahuzanz's user avatar
0 votes
0 answers
12 views

how can I delineate prediction interval for exponential model in excel?

I have built an best fit model for an exponential regression, and I would like to show the upper and lower limits of prediction interval. I have tried to find a way to do that under Data analysis ...
Khal Aboudi's user avatar
1 vote
1 answer
34 views

Is pandas converting a column of lists into floats after the dataframe reaches a certain size?

I am try to use pandas to analyze the Ao3 dataset. Specifically I am trying to track the growth of the ten largest fandoms. To do this I need to see if any given work has one of those ten fandoms. The ...
lutherp's user avatar
  • 21
0 votes
0 answers
24 views

Automatic Execution of Sagemaker Autopilot Generated Notebook

I'm able to upload data from my local machine to my s3 bucket, create an autopilot job given that data, have the file outputs from the autopilot job put back into my s3 bucket, and download the ...
apilot's user avatar
  • 1
1 vote
1 answer
43 views

how to replicate a specific tableau measure in power bi using DAX

I have a critical problem to replicate a tableau measure in power bi using DAX. this is the tableau measure: tableau_measure = [working_time] / CASE ([Country]) WHEN 'Italy' THEN 40 * 60 * ({FIXED ...
simon_b's user avatar
  • 11
-2 votes
0 answers
25 views

Cloud computing or data science [closed]

I want to know which one is better cloud computing or data science in 2024. I just want to know about this ques. As in engineering 2nd year we have to select minor subject so i want to know which one ...
Akshat Swami's user avatar
-2 votes
1 answer
24 views

Which is the best website or YouTube channel for learning ai-ml from scratch [closed]

I started programming few months back and know a little bit of python and front-end web development. and learn ai-ml from scratch so please suggest best sources for learning. I have tried a few ...
Parvesh Kumar's user avatar
-9 votes
0 answers
33 views

Test and Training Python [closed]

I am just starting with this linear regression, test and training thing in python and i only limit to know it as we train with some part and test with other part but why do we do it for accuracy or ...
Aayush Shrestha's user avatar
-1 votes
0 answers
28 views

Tracking and understanding the effect of A/B tests run sequentially with only partial overlap of customers

Here's the scenario: The first test (A/B test 1) had of course test and control, let’s call them test 1 and control 1. Test 1 won and became the standard for what customers see. A few days later, the ...
Hanna Fischer's user avatar
-3 votes
0 answers
17 views

How to train handwriting model? [closed]

I saw a project called handwriting-synthesis by sjvasquez. I really wanted to train my own model to match my handwriting, but I am unsure how to begin. Basically, I'm just not sure how to input data ...
Lyfe Yen's user avatar
-5 votes
0 answers
21 views

git add . is not giving me the correct answer [closed]

Untracked files: (use "git add ..." to include in what will be committed) .gitignore Diamondprediction.egg-info/ README.md Setup.py build/ ...
Shubham Barbaile's user avatar
-1 votes
1 answer
47 views

Convert timedelta (with days) to total seconds

I need to covert Time Elapsed to total seconds. I used three functions with no luck. First function: ny["Time Elapsed"].time() AttributeError: 'Series' object has no attribute 'time' Second ...
Ab3ila's user avatar
  • 13
-1 votes
0 answers
20 views

Feature selection for Regression

I am doing a school project in which I (1) look for correlation between teacher scores and algorithmically computed scores using computational linguistics (CL) features in creative writing, and (2) ...
kennethhdw's user avatar
0 votes
0 answers
15 views

Llama Index custom embeddings - difference between getting text embeddings vs query embeddings?

I'm looking here at the Llama index documentation to create custom embeddings: https://docs.llamaindex.ai/en/stable/examples/embeddings/custom_embeddings.html I'm confused at the documentation - what'...
Eisen's user avatar
  • 1,717
0 votes
0 answers
24 views

Tensorflow: Failed to convert a NumPy array to a Tensor (Unsupported object type int)

I am receving error "ValueError: Failed to convert a NumPy array to a Tensor (Unsupported object type int)." on nn_model.fit line below. Here my data.csv file contains columns: text (type ...
Deepak Soni's user avatar
0 votes
0 answers
16 views

Adding Value to a Help/ Service Desk Using Data Science [closed]

I work at a Service Desk for a healthcare system, and I am aspiring to be a Data Scientist. What are possible ways I can add value to this department using Data Science? We use ServiceNow for our ...
Dtrade84's user avatar
0 votes
1 answer
64 views

combining 100,000 csv files and adding missing information on each iteration

I'm writing a code which pulls together around 100,000 text files and adds missing data. Calling pandas df each iteration is slow, is there a more recommended way? for root, dirs, files in os.walk(...
josh's user avatar
  • 47
0 votes
0 answers
25 views

multiple linear regression and predict in r-studio?

load dataset marketing from library datarium apply multiple linear regression and verify the hypotesis Can the amounts spent on the different channels influence sales? apply two other methods and ...
Francesco's user avatar
0 votes
0 answers
50 views

Plot the most purchased (max quantity) item per month

I am working on an Online Retail Dataset. I want to plot a time series graph where in it has the item that has the most quantity sold per month. text --> link for the data set. So far here is my ...
ElectronEnthusiast's user avatar
-1 votes
0 answers
52 views

How to solve if it appears Error: arguments have different crs?

library(ggplot2) library(gganimate) library(transformr) # data frame into output2 output2 <- oecd_selected %>% select( country, year, `% DPT Immunisation of Children`) # ...
Annisah Noviatikah Sari's user avatar
-3 votes
1 answer
41 views

ValueError: could not convert string to float: 'F. Robertson' ​ [closed]

I tried to create Logistic Regression, but I received such error: "ValueError: could not convert string to float: 'F. Robertson' ​". I drop columns with name of players. fifa_df_2.drop(...
Dmytro Pakhaliuk's user avatar
0 votes
1 answer
35 views

RMSE of a multi-output regression model (using sklearn mean_squared_error)

I tried two ways in getting the RMSE of my multi-output regression model: # method 1 mean_squared_error(y_test, y_pred, squared = False) AND # method 2 math.sqrt(mean_squared_error(y_test, y_pred)) ...
Ronald Cabaoig's user avatar
0 votes
1 answer
35 views

Gspread causes costs?

I need to do operations in a google sheet with python. I'm searching for a library that help me in this task. I found Gspread. But I need to know if the library causes costs in my account of google. I ...
Santiago Zuluaga's user avatar
0 votes
1 answer
65 views

Divide data into clusters by a linear function

I have a number of rows, which form three noticeable lines on a graph. Sample data line_position,queue_number,real_seq 0,2280,41171 55,3375,24999 55,733,11506 45,3939,29185 80,1522,14121 70,1022,...
Pavel Botsman's user avatar
-1 votes
0 answers
45 views

Shap values in xgboost thorughing value error with 1000 samples

I'm using below code to generate shap plots def plot_shap( n_sample: int = None, n_features: int = None, model_output: dict = None, title: str = None ): if n_sample is not None: ...
Python_help's user avatar
-3 votes
0 answers
47 views

Which database should I use to store json file data [closed]

i have a data in json file [ { "pincode": 123456, "bigrams": [ { "locality": "xyz nagar", "frequence": 123 }, ...
Gaurav Verma's user avatar
2 votes
2 answers
40 views

Filter pandas dataframe for rows with a specific date

I am new to python (I have used R in the past). I have a pandas data frame with one column containing dates. I would like to filter for observations occurring on one specific date. ## Create the ...
Kelsey Butler's user avatar
0 votes
0 answers
25 views

Which hypothesis test should I Use? Help pls [migrated]

I'm doing a personal project and would like to see if High Caloric Food has a statistical significance on Weight Level. I've tried Chi Squared Contingency test as suggested by chatgpt but it gives a p-...
Oscar Yip's user avatar
0 votes
0 answers
36 views

How to get data from the past 12 months?

I have a dataset that updates on a daily basis, and I am trying to create a bar chart that shows the number of sales for each sub-category within the past 12 months. This is what my dataset looks like:...
JShec's user avatar
  • 13
0 votes
0 answers
16 views

How to apply Grad-CAM on video

I have VGG-19 trained without its final dense layers trained to receive an array of shape (None, 224, 224, 3) where None is the number of frames contained in the video. I am trying to find a way to ...
Pablo N.'s user avatar
-1 votes
0 answers
17 views

How do I download every 10-Q filing from the SEC's EDGAR database?

I understand there is an RSS feed, does it go back that far? How do I even ensure I scrape just the 10-Qs/Ks, and nothing else? My python is OK, so just a nudge in the right direction will help me. ...
PythonicChris's user avatar
0 votes
0 answers
17 views

How to Add distance constraint on Capacitated Vehicle Routing Problem?

Can someone show me how to add another constraint here which is distance. like the max distance for 1 vehicle should be 1200? """Capacited Vehicles Routing Problem (CVRP).""&...
Ficky Milando's user avatar
0 votes
1 answer
57 views

how to extract the 3 highest values from each year in a DataFrame

I have a DF with a lot of rows, and and this data basically is divided by year. To make the explanation more direct, I will give an example. Let's assume this database I want to have a new df with ...
Bruno Queiroz's user avatar
0 votes
0 answers
19 views

XGBoost and count:poisson

Quick question: the XGBoost library lists count:poisson as one of its learning task parameters. The official documentation is pretty limited and only says: Poisson regression for count data, output ...
Louloumonkey's user avatar
-3 votes
1 answer
65 views

numpy.ndarray' object is not callable

I have a database and I'm required to make a make a bar plot of the na_count. However, I'm trying to make a list of both na_count keys & values, but this message is coming up "'numpy.ndarray' ...
Ab3ila's user avatar
  • 13
1 vote
1 answer
63 views

Nav bar inside menu page

I am trying to set up a nav bar inside a menu control element page. instance_md = """ # <strong>Data</strong> Upload ## Let's upload data now """ download_md ...
Aravind R K's user avatar
-1 votes
0 answers
34 views

Why is did it say tuple out of index and how to fix it? [duplicate]

I was trying to make a model to predict the clickbait article, by using the following dataset, https://www.kaggle.com/competitions/clickbait-news-detection/data (I combined the training and validation ...
Rigo34's user avatar
  • 1
0 votes
1 answer
85 views

Merge two tables from names

I have two table that has football players data and I will merge them from the name feature however one table has feature 'long_name' and other has 'short_name'. For example one player has name "...
Mocak's user avatar
  • 13
0 votes
3 answers
98 views

Why am I getting a "can't multiply sequence by non-int of type 'float'" error even when x is declared as a number in this function?

I am new to python and assigned with creating a simple function that converts temperature of one kind (C, F, K) to another. Simple enough, but when using x, default value set to 0, as an input in my ...
LeroyBrown's user avatar

1
2 3 4 5
183