Questions tagged [disk-access]
Disk access is where a program reads or writes directly to a storage media. Use with the language tag you're trying to perform the access with.
51
questions
-1
votes
0
answers
17
views
Server slow - IO utilized at 100 % but does not match with iotop
I am managing a server with about 200 users. It's been 2 weeks the simplest commands are lagging.
For instance, listing the 250 directories takes about 3 seconds:
[root@hpc home]# time ls
real 0m3....
1
vote
0
answers
189
views
Git Bash/SCM issue with 100% disk usage
After using VS Code and running the bash terminal with some simple npm commands, I quickly see that my disk drive usage jumps from the typical 2%-5% up to 100% and it holds it there constantly.
Even ...
0
votes
1
answer
132
views
Meaning of the statement - du -sk * |sort -rn|head
I am facing trouble understanding the meaning of the Linux command du -sk * |sort -rn|head. I understand that du is used to display the disk usage but I'm facing trouble understanding the rest of the ...
0
votes
1
answer
639
views
Calculating the total disk usage for a set of subdirectories across a directory tree?
Here is the scenario.
Imagine we have this style of directory stucture -
/snapshots/201801/users/tom/
/snapshots/201802/users/harry/
/snapshots/201803/users/chris/
and so on.
What I'm trying to get ...
0
votes
2
answers
287
views
docker clean up container overhead
I have two docker containers running, where the diskspace is as follows:
user$ sudo docker system df
TYPE TOTAL ACTIVE SIZE RECLAIMABLE
...
0
votes
2
answers
1k
views
Android Studio using 100% of disk
I have just installed Android Studio to follow a react native project and everytime I try to use the program the disk usage goes to 100%.
I've chosen Pixel 2 as the phone and android Q and R as the ...
0
votes
0
answers
64
views
Difference in actual usage and disk utilized for Microsoft SQL Server 2012
I am trying to monitor database utilization for one of our applications. Issues observed are that actual utilized disk space by the database is more than the result we got by checking the utilization ...
0
votes
1
answer
228
views
False excessive disk usage, how to explain DF-system and DF-docker contradiction?
At Linux server I checked disk usage by df command and obtained big /var/lib/docker usage
Filesystem 1K-blocks Used Available Use% Mounted on
udev 4078144 0 4078144 0%...
1
vote
1
answer
868
views
Bytes returned by "disk_usage" from the shutil library doesn't match the directory file size
I was reading the official documentation of shutil from the Python website, then I ran a disk_usage test, but it isn't returning what I was expecting, Inside that directory (folder) there's a single ...
26
votes
2
answers
28k
views
How can I determine the current ephemeral-storage usage of a running Kubernetes pod?
How can I tell with kubectl how much ephemeral storage a pod is currently using?
In a Kubernetes pod spec, I can specify resource requests and limits for CPU, memory, and ephemeral storage:
...
0
votes
1
answer
115
views
Python - high disk usage in SumTree
I've encountered some weird behaviour of my python program. Basically when I tried to create adn fill a SumTree of length larger than 1000, my disk usage increases a lot to ~300MB/s then the programme ...
3
votes
1
answer
4k
views
Apache Kafka: reduce kafka disk usage
I have a question about Kafka's disk.
Kafka will fail when its disk become full.
So I want to reduce the disk usage to less than x% by discarding the old data stored on the Kafka disk (or discarding a ...
0
votes
1
answer
35
views
Tablesize and array text[] in postgresql
Ok, here is the question.
I have some table which I create like
create table maths(
id1 bytea
, id2 bytea
, comment text[]
)
there's more columns but that's insignificant. After ...
2
votes
1
answer
702
views
SQLite: will it write to disk when updating same data?
A client application receives a table from server and stores it in local SQLite database. The table is sent frequently but changes rarely, so most updates insert into local database data that is ...
0
votes
0
answers
78
views
WinSock2.2 stops responding when i do disk operations
i've write a socket class in C++, the design is event-based, that means, every 64 players it will create a new thread to handle these sockets. My problem is, when i start reading a file, or write, or ...
0
votes
1
answer
85
views
Store images economically in android app
My app uses images from a URL and I want to reduce resources usage for both server and client.
I wonder if the Android SDK already offers something for this (if there's some standard way to do it) or ...
0
votes
2
answers
472
views
MySQL add column without adding any physical data / increasing storage usage?
I have this large table (hundreds of thousands records) to which a column must be added. The column only stores boolean (tinyint 0/1).
The goal is to avoid extra storage usage for already existing ...
-1
votes
1
answer
204
views
Which addressing mode to be used to access disk?
I am learning OS development and I'm in preliminary level. I created a simple boot loader. To access other files on the disk(say HDD or USB drive), which addressing mode should I use?(CHS or LBA or ...
2
votes
2
answers
2k
views
Why du command show different total in folder versus in parent
I can't understand why I have different total size in a folder versus in parent.
That's my folder tree
bkp
|-- raid10
| |-- folder_a
| |-- folder_b
| |-- folder_c
| |-- folder_d
| ...
1
vote
1
answer
99
views
Why used space calculated, for a directory, using java and 'du -sk' are different ?, and what is the exact java alternative for 'du -sk'?
Why used space calculated, for a directory, using java and 'du -sk' are different ?, also what is the exact java alternative for 'du -sk'?
PFB Java Code,
final String location = "/home/bhlabhla";...
9
votes
1
answer
801
views
How would I check how busy the HDD is with PHP?
I've noticed that some cloud hosting solutions have really poor Disk IO. This causes a few problems that could be solved by having the script wait until the disk was less busy.
With PHP is it ...
0
votes
1
answer
448
views
Disk usage - du showing different results [duplicate]
I am confused with du command because it gives different result for files.
[root@gerrh6-05 sathish]# du -s saravana/admin/sqlnet.ora
4 saravana/admin/sqlnet.ora
[root@gerrh6-05 sathish]# du -h ...
26
votes
7
answers
31k
views
Any solution for Android Studio slow gradle build and high disk usage?
My 4GB RAM, Intel Core i5 system came down down to its knees with high disk and RAM usage by Android Studio(I can see it in the task manager, nothing else is using the RAM and disk). The gradle build ...
0
votes
2
answers
280
views
A table with a XML field with null value, consumes some space? How much?
There are an "official benchmark" or a simple rule of thumb to decide when space or performance will be affected?
My table have many simple and indexed fields,
CREATE TABLE t (
id serial PRIMARY ...
0
votes
1
answer
1k
views
How to free up unused space after deleting documents in ElasticSearch?
When deleting records in ElasticSearch, I heard that the disk space is not freed up. So if I only wanted to keep rolling three months of documents in a type, how do I ensure that disk space is reused?...
0
votes
2
answers
186
views
Android Dev - Strict Mode Problems
I am having an issue with StrictMode i have the following AsyncTask
class pruneDiskCacheTask extends AsyncTask<Void, Void, Void>{
@Override
protected Void doInBackground(Void... params)...
1
vote
2
answers
3k
views
Find directory space on disk with powershell
I wanted to know the size of my different sub-directories, so I followed the indications of Getting Directory sizes powershell and Display directory structure in powershell and some others here in SO ...
0
votes
2
answers
3k
views
How to intentionally slow down a python script so I can have it running forever in the background while I work?
So basically I have a list of 300 values and different averages associated with each one.
I have a for-loop that generates a list of ten of these values at random, and writes it to excel if certain ...
0
votes
2
answers
942
views
How to show the CPU and disk usage in a JProgressBar?
I want to display the current cup usage and disk usage in two separate JProgressBars. And also it should update second by second. How to do it using java? I am quite new to java programming, so please ...
1
vote
1
answer
84
views
as3, gamedev, file access, uncompressing is very slow
Description
~~~~~~~~~~~
I have around 100 files that represents around 450 Mo to load a game. I'm not parsing anything, just loading raw data (ByteArray).
Problem
~~~~~~~
On desktop using File, ...
2
votes
2
answers
2k
views
Use awk to display devices with disk usage above 10%, and print the column headings as well
The below command displays devices with file system usage above 10%. However it is not displaying the column headings. This is the command I use:
df -Ph | awk '+$5 >= 10 {print}'
I want output ...
0
votes
1
answer
289
views
MySQL record disk-usage calculation | Am I right?
I am trying to estimate the real disk-usage required space for each record of my table in MySQL RDBMS.
The table has a structure like this:
ID INT 4 byte;
VARCHAR(34) 34 byte;
INT 4 byte;
INT(5) 4 ...
1
vote
2
answers
973
views
Matlab: direct/efficient untar to memory to avoid slow disk interactions
Given a .tar archive, Matlab allows one to extract the contained files to disk via UNTAR command. One can then manipulate the extracted files in the ordinary way.
Issue: When several files are stored ...
0
votes
2
answers
854
views
File system stats
I use the following code to find the disk usage of my /
int main()
{
struct statfs *stat;
statfs64("/tmp",stat);
perror("");
printf("%lu \n",stat->f_bfree*stat->f_bsize);
...
1
vote
3
answers
2k
views
Is there a faster way to get disk usage starting at a specific directory in powershell?
I've been using the following piece of code to get the disk usage starting at a specific directory:
$usage = (Get-ChildItem $webRoot -recurse | Measure-Object -property length -sum)
$diskUsage = $...
0
votes
1
answer
1k
views
Determine iOS application's total disk usage/filesize
I have an app that allows users to download files and save them to the device's internal memory. I need to be able to display the total app disk usage at any given time. I found how to check the total ...
0
votes
1
answer
325
views
PostgreSQL JOIN, under the hood
I have question about PostgreSQL join.
Does PostgreSQL create temporary table for JOINed tables or it makes everything
without any temporary tables?
The reason of my question is:
When I make SELECT ...
2
votes
1
answer
1k
views
NSURLCache : says its caching, isnt, and no change in memory stats
I am attempting to confirm URL caching by logging the memory stats around a NSURLCache.
I have extended the base NSURLCache as follows:
@implementation MarksCache : NSURLCache
- (...
1
vote
1
answer
334
views
Escaping singlequote in random filenames
I have a simple bash script which outputs the total file size using 'du'
However every time I pass a file that contains an apostrophe it presents me with a syntax error.
So I'd like to know if there ...
2
votes
1
answer
138
views
Getting number of disk accesses from BufferedStream
I'm reading a binary file using BinaryReader. I want to count the number of disk accesses when buffering input with BufferedStream. Unfortunately this class is sealed, so I can't override method to ...
2
votes
2
answers
369
views
app on ipad double archive size
Hi guys I have a media heavy app for the iPad and my archive is ~370mb. For what I'm doing, that isn't unreasonable. If i view the xcarchive in finder it is ~391MB, the .ipa is ~388mb, which roughly ...
1
vote
2
answers
412
views
Reduce number of disk access while writing to file in C
I am writing a multi-threaded application and as of now I have this idea. I have a FILE*[n] where n is a number determined at runtime. I open all the n files for reading and then multiple threads can ...
0
votes
1
answer
237
views
Cache store for .net library encapsulated classes
I am writing a dll with a number of high-level utility classes, that other developers will consume and use in their applications.
Currently I am working on an implementation of a class, that has to ...
0
votes
1
answer
95
views
Latex rendering needs too much disk space in MediaWiki?
Not totally sure that Stackoverflow is the best place to ask this question, but since I see a slew of other MediaWiki questions that have already been posted, I suppose my question is appropriate.
My ...
1
vote
3
answers
217
views
Best to use: mysql column or file check to detect image?
I always have a dilema: For a record, I can use column images (tinyint) that is true if there is image for that record or false if there is not.
I can also not put that information in the database ...
0
votes
4
answers
708
views
Is there a shell script that can monitor partition usage?
When I used to use cPanel it would send me an email when any partitions were approaching full. Is there a script out there that monitors df output that I can put in a cronjob?
Thanks
8
votes
1
answer
6k
views
Detect block size for quota in Linux
The limit placed on disk quota in Linux is counted in blocks. However, I found no reliable way to determine the block size. Tutorials I found refer to block size as 512 bytes, and sometimes as 1024 ...
0
votes
1
answer
533
views
Is there a Tool to View Disk Usage on a Team Foundation Server DB
We have a TFS installation on a machine that is close to going out of support life and we're planning on migrating to a new machine in a couple of months. However in the meantime we are getting ...
0
votes
2
answers
63
views
Minimizing disk accesses when getting attributes of files in a directory
As the title suggests, I'm looking for a way to get attributes of a large number of files in a directory, but without adding the cost of an additional disk access for each file.
For example, if I get ...
49
votes
3
answers
27k
views
Does a varchar field's declared size have any impact in PostgreSQL?
Is VARCHAR(100) any better than VARCHAR(500) from a performance point of view? What about disk usage?
Talking about PostgreSQL today, not some database some time in history.