Questions tagged [data-analysis]
Data Analysis involves extracting meaning and insights from raw data. It involves methods and algorithms that examine, clean, transform and model the data to obtain conclusions.
4,685
questions
0
votes
1
answer
33
views
How do I easily plot data in R (line plot), that were adjusted for confounding variables?
since I now understand how to line plot data with multiple timepoints in R using ggpubr package, I want to plot data that has been adjusted for some known confounding variables in the data set.
What I ...
0
votes
3
answers
52
views
How to compare rows after a particular column in BigQuery SQL?
SQL Gurus, I have got a problem and I have no idea how to solve it. I have a table like this in BigQuery:
id ga_id first_date second_date
A B 2023-08-01 2023-09-...
-1
votes
0
answers
29
views
How to create a quantity vs time-scale chart on Excel
Context: I want to make a chart in excel where I can clearly see the trend of those who buy tickets for a particular event. To do this, I've been given a set of data on an excel sheet, including, and ...
0
votes
1
answer
37
views
Postgresql- theowing an error running a basic query
i am trying to run a query from a dataset but its throwing an error, please help me out.
select * from online_retail
where quantity= '6'
ERROR:
column "quantity" does not exist
LINE 2: ...
0
votes
0
answers
16
views
Merging Power Bi Tables based on calculated field... maybe using DAX
I have two tables such the Table1 has columns like [date,totual purchased,...] and table two has columns like [date, revenue,...], where ... is many other columns not to important. However both date ...
-3
votes
0
answers
32
views
How can i overcome this Keyerror:'Niveau' in python? [closed]
I tried to analyze my CSV data which contained 4 columns where "Niveau" is one of them. I have this code which is given below and I expected that the code would run but i got the error ...
0
votes
0
answers
14
views
Reading mf4 data through asammdf and getting unexpected data structure
I am relatively new to python and am trying to do some data post-processing through it. I am using the asammdf library to read an mf4 file. I can perfectly open it with NI DIAdem, therefore I know ...
-2
votes
0
answers
38
views
Why does python keep bringing up errors when I am trying to UMAP-analyze data and yet I am following a tutorial word by word? [closed]
How do I fix the error below? As you can see, the error that Jupyter notebooks brought when I attempted to run this code:
embedding = umap.UMAP(random_state = 42).fit_transform(data)
Jupyter contends ...
1
vote
1
answer
38
views
Power BI DAX Measure: Counting the distinct number of users by nested way of filtering
I tried multiple ways to do this, but just can't find the final solution.
Precodition: it has to be a MEASURE, NOT calculated column
So my table looks like this:
Name
Skill
Level
John
SQL
2
John
...
1
vote
0
answers
12
views
Analytical metric for comparing average run times?
I have a list of scripts and how long they take on average:
const averageRunTime = [
srt_id:1, avg:8, // 8 seconds
srt_id:2, avg:600, // 10 minutes
srt_id:3, avg:3600 // 1 hour
]
So the ...
0
votes
0
answers
47
views
how to create age groups in rstudio with dplyr
how to create age groups in rstudio with dplyr, before 1 year, between 1 and 4 years, between 15 and 29 years, between 30 and 59 years and after 59 years. After that, I have the mortality rate ...
0
votes
0
answers
67
views
How to efficiently transpose PySpark dataframe with one row and many integer columns
Say I have a df with this structure:
Long Long Long Long Long Long
A B C D E F
4 2 7 9 1 3
How do I efficiently transpose such that it ends up like:
String Long
...
0
votes
0
answers
13
views
using one slicer (date) with two different tables and two different data columns in power bi. i want to solve this problem
using one slicer (date) with two different tables and two different data columns in power bi. i want to solve this problem .I have already addressed this using a date table, but I am interested in ...
0
votes
0
answers
11
views
How to match combination string which is not in same order in Looker?
I've a column named country combination beside which total count column states the count of how many times that country combination has appeared. I'm trying to create a pie chart in Looker to see ...
0
votes
0
answers
14
views
MALFORMED_DATE Error During Import with Mixed Date Formats in QuickSight
Hello QuickSight Community,
I am encountering an issue during data import in QuickSight, specifically a MALFORMED_DATE error that results in skipping rows. The data column in question contains date ...
-4
votes
0
answers
73
views
How do i solve this complex non-linear method with js?
Net = ( basic + housing + transport ) - (PAYE + INSS )
Tables(Gross)
basic : x
housing : 30 % of basic
Transport Allowance:
Net Salary Range Transport Allowance
0 to 500 50
501 to 750 ...
-1
votes
0
answers
33
views
how can get the churn by agency more than 700 agency without using countplot
i'am trying to get the churn by agency, the number of agency is more than 700, iam using the countplot and that's what i get
enter image description here
Can anyone help me please, how else can I do ...
-3
votes
0
answers
24
views
is there any sources for practicing statistics in excel [closed]
I want to practice statistics in excel but I dont find any good resources for it. if you can help me i would be glad.
a source with answers for statistics Excel
having a real dataset in fmcg category
...
0
votes
0
answers
22
views
Issue in sorting data in hierarchy wise using slicer option
Data considered in matrix
Rank Slicer selected as 3 but i was getting all sites instead of only rank with 3 Details about my data:
i am having table(Table Name: MGR) with columns as Date, Plant Name, ...
-1
votes
1
answer
26
views
Average and Median of values of 4 columns for each row in DAX
I have 4 columns, Col1,Col2,Col3 and Col4
I need to add 2 calculated column that get the Average and median of 4 values of those 4 columns from each row.
That's should be DAX,no need power query
Col1
...
-1
votes
1
answer
40
views
How to filter NULL results in chart filter?
I want to use chart filter of Looker studio, but data filtered just TRUE and False result.
How to use condition on chart filter?
Chart and table not use any filter.
I am expected, that chart will ...
0
votes
0
answers
57
views
How can i overcome the KeyError: in Python?
I wanted to analyze the CSV datafile with the help of python. but an error occured saying KeyError:Niveau. "Niveau" was the name of the column that i had in the CSV data.
i had a CSV file ...
0
votes
0
answers
30
views
DAX Running Stock Total
We are trying to get a predicted running stock total using inbounds and sales forecast. We keep running into cyclic errors, referencing the column we are creating in the formula. I will explain this ...
1
vote
1
answer
36
views
Set a Value Threshold in R
I have the following data frame:
Parameter
Value
0NO2
46
00O3
56
with a lot more parameters
c("00C6H6", "00CO", "00HR", "LAEQ", "00NO2", "...
0
votes
1
answer
19
views
Multiple target values for fraud detection
I have a dataset which has multiple values in the target column. The problem I'm solving is a financial (loan) fraud detection problem where I am trying to identify perspective defaulters.
I haven't ...
-2
votes
0
answers
30
views
Is there a better way to do this with all numpy?
Is there a better way to do this code block?
self.csOn = np.sort(np.concatenate((self.prfOn, self.crfOn, self.clickerOn), axis = 0))
self.csOff = np.sort(np.concatenate((self....
0
votes
0
answers
12
views
I am looking for a way to cluster spatial data in a balanced way
My input data is 1000 points, each of which has a profit column and a longitude and latitude column. I want to do clustering in such a way that it takes almost the same time to travel the distance ...
0
votes
1
answer
27
views
Keyerror : 'count'
I want to plot a interactive bar plot using plotly.express
state_count = df['state'].value_counts().head(10)
state_names = df['state'].value_counts().head(10).index
Bar_plot = px.bar(df,state_names,...
-1
votes
0
answers
17
views
Where can I find images of courier packages for creating a dataset?
Need Images of courier packages from real life, not stock images to create dataset.
I tried to search in amazon reviews and also in google images which so far is not fruitful. The images should be ...
0
votes
1
answer
42
views
How do I get data from several files in one histogram? [duplicate]
For a data analysis, I display the data from the individual folders in individual histograms. In order to get a better overview of the scatter of the measured values, I would now like to display all ...
0
votes
0
answers
41
views
Data analysis and computing heat index from temperature and humidity data to graph in Python
So I'm trying to calculate heat index from the data that 13 different sensors upload into a shared google drive. A picture of what the data looks like is attached here: https://i.stack.imgur.com/VDCWQ....
-1
votes
0
answers
39
views
Creating a pandas from a URL and then sort the data
Good morning! I need help with generating a table using pandas. I want to fetch data from the table in this URL: https://www.eia.gov/dnav/pet/hist/rbrteD.htm and create a table with only two columns: &...
0
votes
0
answers
21
views
Error in CA (data): The following variables are not quantitative:
(please if you see that my question is not good don't dislike it because this cause me problem later)
I tried to use CA () function from library (FactoMineR)
on a data that I read from a csv file, ...
1
vote
1
answer
44
views
Getting negative value when subtracting two time columns in the PowerQuery
I'm just working on the Google's Data Analytics capstone case study. In the give dataset, I need to find the difference between ride started time and the end time. I got correct values overall except ...
-1
votes
2
answers
51
views
Fill missing values of a column by mapping the column values with a different column
The dataframe looks like this:
Year
Month
2021
10
2021
11
2021
12
2022
1
2022
2
2022
3
NaN
1
I have to fill the null value in the year column by checking the year of the corresponding month ...
0
votes
1
answer
34
views
Process a pandas DataFrame in Chunks or optimize memory usage for aggregation features
I'm working on a Jupyter notebook in Python with Pandas for data analysis.
When creating new aggregation features, I encounter a "MemoryError" due to the memory capacity of my system.
Before ...
1
vote
3
answers
64
views
Moving incorrect values into the right column using R
I have a column called Brand_ID where the ID's are supposed to range from 0-6 but there are User_ID numbers that were incorrectly recorded in my Brand_ID column. I've been having trouble finding a way ...
0
votes
1
answer
50
views
How can I fit a dataset with linear function and then with a cosine function?
I need to fit with Python the following dataset in such a way that for x from -0.65 to -0.049 the fitting is linear and from 0.049 to 1.85 a cosine with a period around 0.400;
x = [ 1.85 , 1....
0
votes
0
answers
19
views
structures corresponding to metastable states in python
I have a question, I currently have a Markov state model with 4 metastable states, what I would like is to find the structures corresponding to those metastable states in python.
1
vote
0
answers
95
views
What is Databricks Unit (DBU) and how is it calculated exactly? [closed]
I have come across multiple blogs regarding DBU but never found a concrete explanation.
As far my understanding right now:
Several factors determine how many DBUs a specific workload consumes, ...
0
votes
0
answers
35
views
Analytics tool for Excel data analysis
I want to use a analytics tool to integrate in my spring boot application where I will be uploading an Excel sheet and the tool will determine the columns to create reports or charts. Which tool will ...
0
votes
1
answer
27
views
Joining PowerBI tables in a new Table
I have multiple tables in power query editor named as CGTMSE_2020-21, CGTMSE_2021-22, CGTMSE_2022-23 etc. Table structure for all the tables are exactly similar. (One sample table is attached as ...
1
vote
0
answers
20
views
Creating Dynamic Book Dashboard in Notion: Seeking Help for Real-time Book Collection Insights
I have a book database in Notion, and the properties with sample data are as follows:
Name
Author
Completed
Cover
Current Page
Description
Expected Reading Speed
Formula
Genre
Price
Progress
Rating
...
2
votes
1
answer
34
views
Why is the Plotly bar chart not proportional?
I need to show on a barchart the weight value registered each Exam Date, but the Y Axis is not proportional to the value registered. 90kg is shown as smaller than 85kg. What am I missing out? Thanks ...
0
votes
0
answers
24
views
Want to know about WESAD Dataset
I'm now working on a project "Stress classification using wearables" for which I'm using the most used dataset for this probem - "WESAD Dataset". I converted one subject's (s2) pkl ...
3
votes
1
answer
41
views
Putting contributions of continuous values in a discrete 2D grid, based on distance from the nearest pixels
I have a numpy array containing coordinates of points (in 3D, but I am have started off by trying the method in 1D and 2D first) that I would like to fit in a discrete grid. However, I do not want to ...
1
vote
1
answer
52
views
Getting "Error: Must request at least one colour from a hue palette." from trying to run ggplot()
Having some error that's preventing me from plotting a PCA plot? Here is my output when I run this set of code on terminal.
> #pdf(file="pca.mouse.control.pdf")
> #performing PCA using ...
-1
votes
1
answer
73
views
Splitting the data by day and creating a line graph to show over time within the day while layering each id over each other
I have a dataset called hourly_steps_merged with many unique IDs in the Id column. I want to group the data by Date and Id since I have a month's worth of data. I want to layer the unique IDs over ...
0
votes
0
answers
19
views
Real Time ML Pipeline Structure
So we have two datasets for which we train our ML models manually at the moment. One dataset is saved to the MySQL database server and it does not get updated and the other dataset gets new data ...
-1
votes
1
answer
30
views
how to find a database that contain the list grants in the world
I'm tasked with creating a real-time visualization of grant recipients, aiming to provide transparency and insights. However, I'm facing a significant challenge due to the lack of an accessible, ...