255
questions
0
votes
1
answer
38
views
How to format the creation timestamp of a ZFS snapshot with TrueNAS? [closed]
I would like to know the precise creation time of a ZFS snapshot. Note that I am not referring to the timestamp in the snapshot name itself but the result of querying the creation property when using ...
0
votes
1
answer
27
views
Enable QuestDB compression on Mac
I want to use ZFS compression on my local environment, using a Macbook Pro M1. For my production environment I didn't have any issues by following the docs, as I have a dedicated EBS volume for the ...
0
votes
0
answers
69
views
How to programmatically detect if a path is a ZFS snapshot?
All ZFS snapshots have paths like "/mount/point/path/.zfs/snapshot/NameOfSnapshot", but not all paths that can conceivably contain "/.zfs/snapshot/" are necessarily ZFS snapshots. ...
0
votes
0
answers
36
views
I would like to measure CPU usage in a function within the kernel module
everyone.
I am studying the ZFS file system programmed in C language.
I would like to measure the CPU usage of each function within ZFS. Is there a way?
At first I tried adding kernel_stat.h, but it ...
0
votes
1
answer
829
views
Error message when starting ddev laravel: "Failed waiting for web/db containers to become ready: web container failed" (zfs)
When I initially cloned a company repository and tried to start via ddev start I got the error message Failed waiting for web/db containers to become ready: web container failed.
The container ddev-...
1
vote
0
answers
174
views
How do I create zfs volumes with docker compose?
I've patched a docker zfs plugin to make it work with docker composes's ideas on container naming, so docker volume create -d zfs my-volume creates my-volume under specified in config filesystem.
...
0
votes
0
answers
61
views
ZFS Unknown command via ssh, but is in $PATH
I am trying to use syncoid to send a zfs dataset to a remote macOS machine, with OpenZFS on macOS installed.
During the run, I get the error: fish: Unknown command: zfs.
I can replicate this error ...
0
votes
1
answer
298
views
Merging two raidz1 vdevs on ZFS to have only ONE redudundant drive
I currently have three 18tb drives under a raidz1 vdev. I bought three new drives to double my space. However when I added these three drives, I can just create a separate raidz1-1.
But that means out ...
0
votes
0
answers
65
views
What is the fastest way to copy a block-aligned extent from one file to annother on FreeBSD & ZFS?
I'm running ZFS with de-duplication turned on (when properly tuned it works well; don't let the internet scare you). Each day I need to take several terabytes of qcow2 images and create fixed-VHDX ...
0
votes
0
answers
40
views
Tried to get zfs to replace faulty drive but ended up in this configuration mess. How to resolve?
Getting the issue below, Trying to replace ata-ST3000... drive but ended up with this configuration mess. How can I get the new drive to be inside raidz1-0? Help appreciated.
Thanks
# zpool status
...
1
vote
0
answers
327
views
Installing zfs on Docker Ubuntu jammy image
I am running into a problem with getting zfs running on a Ubuntu jammy (22.04 LTS) Docker image.
If I start with a fresh image and run
apt update
apt install zfsutils-linux -y
zpool create ....
I get ...
1
vote
1
answer
718
views
How I do "NVMe overprovisioning"?
I want to use NVMe overprovisioning on a NVMe disk with ZFS. I have read this: https://openzfs.github.io/openzfs-docs/Performance%20and%20Tuning/Workload%20Tuning.html?highlight=ashift#nvme-...
2
votes
2
answers
4k
views
How to list the features of a ZFS pool?
How can I list the features of a pool?
With zfs get all <pool> I can see the list of properties and their values of a pool. But not the features: https://openzfs.github.io/openzfs-docs/man/7/...
0
votes
1
answer
352
views
ZFS: "convert" a pool into a filesystem
I've created a pool trunk that is mounted under say /X. I didn't realize that I should have created a filesystem on that pool, so people on a shared server started to directly write into /X. Now I ...
-1
votes
1
answer
897
views
ZFS how to make 'receive' create the filesystems?
I'm running a ZFS NAS on OmniOS in conjunction with NappIt UI.
In order to upgrade the capacity I was planning to exchange the disks one by on.
But that was impossible since the new disks have 4096 ...
0
votes
1
answer
69
views
What consumes the space difference between a zpool and its contents?
I have a zpool 'zoo' on mirrored 2 * 1TB drives:
[develop@silversurfer /mnt/zoo]$ zfs list -r zoo
NAME USED AVAIL REFER MOUNTPOINT
zoo 829G 69.9G 996M /mnt/...
1
vote
1
answer
2k
views
ZFS stalled, task txg_sync blocked for more than 120 seconds
A scrub was running, which got stuck, I restarted the server to attempt to resolve the issue, however this caused ZFS to stall instantly (zpool, and zfs) commands just run indefinitely with the ...
0
votes
2
answers
521
views
Why do these 2 ZFS pools have different allocation and capacity, even thought they have the same files?
I have two zpools on ZFD:
the zpool on top is 8 disks 2 TB each in raidZ3
the zpool on bottom is 4 disks 4 TB each in raidZ3
The data is EXACTLY the same. I even ran diff -qr /top/zpool/ /bottom/...
0
votes
1
answer
849
views
Recovering zfs pool
I have a zfs pool setup on my ubuntu 20.04 system. I had 4 drives and decided to replace 1 of them for a larger one. I tried to offline the drive, then powered off, replaced with new drive, powered ...
1
vote
0
answers
2k
views
docker mysql - The designated data directory is unusable
I have a mysql docker container that maps its data and logs directories onto a host path.
The host paths are two separate zfs mount points.
When I try to start MySQL it is reporting:
[Entrypoint]: ...
0
votes
1
answer
2k
views
I need docker instance to NOT utilize the host swap
My server build uses a lot of swap per container and I am told that docker uses the host swap for instances. My host ssd is only 256gb and is only intended to run the OS. I have setup a zfs pool (9 Tb ...
-1
votes
1
answer
478
views
samba shadow copy cannot match
The test machine is running Ubuntu server 20.04 LTS, I'm tring to expose zfs snapshots to samba share as shadow copies but failed.
Here is the smb.conf share block:
[Storage]
comment = NAS Storage
...
0
votes
2
answers
2k
views
ZFS send single snapshot including descendent file systems
Is there a way to send a single snapshot including descendant file systems? 'zfs send' only sends the the top level file system even if the snapshot was created using '-r'. 'zfs send -R' sends the ...
1
vote
1
answer
214
views
Is mysql/docker/zfs safe? [closed]
We are looking to use mysql or mariadb within docker on zfs.
I've seen a few old articles that seem to suggest that you need some special configuration options for zfs.
https://github.com/docker-...
3
votes
2
answers
2k
views
Right way to use docker rootless mode on ZFS filesystem
I configure my docker to be used with rootless mode and it works fine. But I changed my data-dir to store all the docker's data in a zfs filesystem. It appears that it is not working directly and I am ...
0
votes
1
answer
2k
views
Unlocking multiple LUKS-encrypted volumes with a single password at boot (Gentoo, encrypted ZFS root, genkernel initramfs)
With this post I am sharing a solution with the community.
I have a Gentoo system installed on a ZFS pool consisting of multiple encrypted devices. It is normally decrypted at boot as described in ...
3
votes
1
answer
695
views
ZFS SSD pool - Postgres setup really slow for large table ALTER command Write operations)
We recently moved a db(1.2TB) cluster from mirrored SSD to ZFS pool build-up of SSD. After the move, I have seen a massive drop in performance on large write operations (Alter table types, vacuums, ...
0
votes
0
answers
129
views
Can fsync(fd) accidentally flush entire Filesystem?
As per API, it just accepts the file fd but is it possible for this operation to accidentally flush the entire filesystem to disk?
For example, if the filesystem is journaling and I do fsync on this ...
-1
votes
1
answer
1k
views
ZFS after disk failure: most of data seems to be intact, but how to extract?
I have a zpool after disk failure. Attempt to import it (even zpool import -F -T 12855264 -R /mnt -f rpool) yields errors
Dec 4 12:56:54 freebsd kernel: Solaris: WARNING: can't open objset 1035, ...
1
vote
3
answers
118
views
Regex string extraction in Perl Script
my text from a cmd output is like this:
pool: pool0
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
...
0
votes
1
answer
2k
views
ZFS send recursive failing on datasets without the specified snapshot
I have a situation in my current zfs pool that I do not quite understand and also cannot reproduce in a testing environment.
I am trying to send an incremental and recursive snapshot to another a ...
0
votes
1
answer
375
views
Licensing issue in ZFS when building kernel with CONFIG_DEBUG_LOCK_ALLOC
When I build the mainline Ubuntu kernel (hirsute) with CONFIG_DEBUG_LOCK_ALLOC on, the build process fails giving the below error message
configure: error: Kernel built with CONFIG_DEBUG_LOCK_ALLOC ...
2
votes
0
answers
520
views
Elasticsearch response times are high even when query time is low
I'm seeing high response times on elasticsearch searches (took is 5000ms) but if I check profile, query time is low ~15ms. I think this only happens when the request rate is high, but CPU is also far ...
1
vote
1
answer
528
views
can a zfs disk be replaced with an imaged-copy [zol]
If I have a theoretical pool "tank" 500gb X 4 drives as devices vd{a,b,c,d}
could I pull vdc from the system, image it (bit-wise clone) onto another 500gb disk, and install the clone (lets ...
0
votes
1
answer
832
views
K0s in LXC and ZFS issues
I'm trying to get K0s working in LXC (LXD) containers on Ubuntu 20.04 using ZFS and I've managed to get past the apparmor challenges (for now at least) but stuck on overlayfs issues during the install ...
1
vote
0
answers
276
views
Single ZFS Checksum error on mirror, sounds improbable to me
I have a ZFS pool with the following layout and errors:
config:
NAME STATE READ WRITE CKSUM
tank ONLINE ...
1
vote
1
answer
249
views
How does Flash Translation Layer store mapping data, unusable block and super block?
Does ftl have private storage space that is not flash?
If not, how does ftl store those meta data while avoiding wear leveling.
Actually I don’t know if there is a super block in ftl, but if you want ...
0
votes
2
answers
3k
views
ZFS pool disk failure but disk looks fine
I have a ZFS pool with 4 disks on Ubuntu (zfsonlinx). All the disks are connected via SATA cables on a secondary controller that I bought. It now hosts Plex media server with movies and photos ...
0
votes
0
answers
777
views
How can i set qouta on docker volume with zfs
I want to set a hard limit for the volume to grow. How can i do it with docker-compose? Right now i have zfs as the fs for /var/lib/docker. My current volume part looks like this:
volumes:
vol1:
...
1
vote
0
answers
229
views
ZFS: Sharing a large number of data sets
I have a situation where I have a zfs pool with a large number of data sets (>8000 and counting) on a single machine.
The structure of these data sets can be simplified as follows:
data/1
data/2
...
1
vote
0
answers
52
views
bash script doing back-up malfunctions when run via systemd
I have bash script that takes ZFS snapshot and via piping uploads it to s3 bucket. This is the gist of it:
torun="zfs send -c ztank/data@$BACKUP_NAME | openssl enc -aes-256-cbc -iter 1000 -salt -...
0
votes
1
answer
326
views
Combining local and remote ZFS snapshoting [zfs_autobackup]
I was searching for a simple way of managing my local and remote ZFS snapshots and decided to give zfs_autobackup a try.
My goals are to keep a local set of snapshots taken at specific times and send ...
2
votes
1
answer
8k
views
How to fix docker storage-driver=overlay2 problem
I need to change the underlying storage for a Proxmox LXC Debian Buster container from RAW to ZFS. For this I restored a snapshot to ZFS storage. This is normally transparent for the OS in the ...
1
vote
0
answers
127
views
ZFS write ordering issue after System Crash?
I'm facing a write ordering issue with ZFS (version 0.7). Finding difficult to understand root cause since I'm new to ZFS internals. Any insight is highly appreciated.
Problem: The user application ...
1
vote
1
answer
469
views
Slow zfs create with thousands of datasets
I am creating a zfs system where each instance of a certain entity in my system has its own dataset in zfs. This is needed because each entity consists of a lot of small files that are really slow to ...
1
vote
1
answer
85
views
Can ZFS snapshotting (or other filesystem snapshotting) restore file system memory components?
I know that ZFS snapshotting can make a copy of file system content like file content, metadata, and directory structure. But does the snapshotting include the in-kernel and in-memory components of a ...
3
votes
1
answer
8k
views
mkfs.vfat: unable to open {partition}: No such file or directory (command succeeds, but throws this error and blocks rest of script)
Update: I got this working but am still not 100% sure why. I've appended the fully and consistently working script to the end for reference.
I'm trying to script a series of disk partition commands ...
2
votes
1
answer
1k
views
zfs: filesystem has dependent clones
I am running Ubuntu 20.04 and using zfs on my system drive.
I am trying to remove a docker container but I get this error:
glen $ docker rm c3250e315b06
Error response from daemon: container ...
2
votes
0
answers
3k
views
Zpool import - one or more devices is currently unavailable
When attempting to import a zpool with -m (also -F and -f and combinations thereof), I receive: "cannot import 'tank2': one or more devices is currently unavailable"
I believe the missing ...
2
votes
1
answer
899
views
Detecting any changes on latest snapshot
Is there a way to quickly check whether there are any changes made on top of the latest snapshot? The goal is to know whether taking another snapshot is necessary.
I have tried zfs diff $...