summaryrefslogtreecommitdiff
path: root/gemfeed
diff options
context:
space:
mode:
authorPaul Buetow <paul@buetow.org>2025-12-07 10:09:52 +0200
committerPaul Buetow <paul@buetow.org>2025-12-07 10:09:52 +0200
commit0f2174384458531aa95a2a4e43e82511e3a01946 (patch)
tree7888b9cf56b75472af7bf9e0f3a9855c1e49a73d /gemfeed
parenta82eb87ae8fae1cd9e0685ed754b615065f02a3e (diff)
Update content for md
Diffstat (limited to 'gemfeed')
-rw-r--r--gemfeed/2025-07-14-f3s-kubernetes-with-freebsd-part-6.md50
-rw-r--r--gemfeed/2025-12-07-f3s-kubernetes-with-freebsd-part-8.md10
2 files changed, 38 insertions, 22 deletions
diff --git a/gemfeed/2025-07-14-f3s-kubernetes-with-freebsd-part-6.md b/gemfeed/2025-07-14-f3s-kubernetes-with-freebsd-part-6.md
index 3f018a28..3dc754bb 100644
--- a/gemfeed/2025-07-14-f3s-kubernetes-with-freebsd-part-6.md
+++ b/gemfeed/2025-07-14-f3s-kubernetes-with-freebsd-part-6.md
@@ -34,15 +34,15 @@ This is the sixth blog post about the f3s series for self-hosting demands in a h
* [⇢ ⇢ ⇢ Verifying replication after reboot](#verifying-replication-after-reboot)
* [⇢ ⇢ ⇢ Understanding Failover Limitations and Design Decisions](#understanding-failover-limitations-and-design-decisions)
* [⇢ ⇢ ⇢ Mounting the NFS datasets](#mounting-the-nfs-datasets)
-* [⇢ ⇢ ⇢ Troubleshooting: Files not appearing in replication](#troubleshooting-files-not-appearing-in-replication)
+* [⇢ ⇢ Troubleshooting: Files not appearing in replication](#troubleshooting-files-not-appearing-in-replication)
* [⇢ ⇢ ⇢ Configuring automatic key loading on boot](#configuring-automatic-key-loading-on-boot)
* [⇢ ⇢ ⇢ Troubleshooting: zrepl Replication Not Working](#troubleshooting-zrepl-replication-not-working)
-* [⇢ ⇢ ⇢# Check if zrepl Services are Running](#-check-if-zrepl-services-are-running)
-* [⇢ ⇢ ⇢# Check zrepl Status for Errors](#-check-zrepl-status-for-errors)
-* [⇢ ⇢ ⇢# Fixing "No Common Snapshot" Errors](#-fixing-no-common-snapshot-errors)
-* [⇢ ⇢ ⇢# Network Connectivity Issues](#-network-connectivity-issues)
-* [⇢ ⇢ ⇢# Encryption Key Issues](#-encryption-key-issues)
-* [⇢ ⇢ ⇢# Monitoring Ongoing Replication](#-monitoring-ongoing-replication)
+* [⇢ ⇢ ⇢ Check if zrepl Services are Running](#check-if-zrepl-services-are-running)
+* [⇢ ⇢ ⇢ Check zrepl Status for Errors](#check-zrepl-status-for-errors)
+* [⇢ ⇢ ⇢ Fixing "No Common Snapshot" Errors](#fixing-no-common-snapshot-errors)
+* [⇢ ⇢ ⇢ Network Connectivity Issues](#network-connectivity-issues)
+* [⇢ ⇢ ⇢ Encryption Key Issues](#encryption-key-issues)
+* [⇢ ⇢ ⇢ Monitoring Ongoing Replication](#monitoring-ongoing-replication)
* [⇢ ⇢ CARP (Common Address Redundancy Protocol)](#carp-common-address-redundancy-protocol)
* [⇢ ⇢ ⇢ How CARP Works](#how-carp-works)
* [⇢ ⇢ ⇢ Configuring CARP](#configuring-carp)
@@ -389,10 +389,14 @@ jobs:
interval: 1m
pruning:
keep_sender:
+ - type: last_n
+ count: 10
- type: grid
grid: 4x7d | 6x30d
regex: "^zrepl_.*"
keep_receiver:
+ - type: last_n
+ count: 10
- type: grid
grid: 4x7d | 6x30d
regex: "^zrepl_.*"
@@ -414,9 +418,15 @@ jobs:
keep_sender:
- type: last_n
count: 10
+ - type: grid
+ grid: 4x7d
+ regex: "^zrepl_.*"
keep_receiver:
- type: last_n
count: 10
+ - type: grid
+ grid: 4x7d
+ regex: "^zrepl_.*"
EOF
```
@@ -633,7 +643,7 @@ paul@f1:~ % doas zfs set readonly=on zdata/sink/f0/zdata/enc/nfsdata
And replication should work again!
-### Troubleshooting: Files not appearing in replication
+## Troubleshooting: Files not appearing in replication
If you write files to `/data/nfs/` on `f0` but they don't appear on `f1`, check if the dataset is mounted on `f0`?
@@ -699,7 +709,7 @@ Important notes:
If `zrepl` replication is not working, here's a systematic approach to diagnose and fix common issues:
-#### Check if zrepl Services are Running
+### Check if zrepl Services are Running
First, verify that `zrepl` is running on both nodes:
@@ -713,7 +723,7 @@ paul@f0:~ % doas service zrepl start
paul@f1:~ % doas service zrepl start
```
-#### Check zrepl Status for Errors
+### Check zrepl Status for Errors
Use the status command to see detailed error information:
@@ -725,7 +735,7 @@ paul@f0:~ % doas zrepl status --mode raw
# Common errors include "no common snapshot" or connection failures
```
-#### Fixing "No Common Snapshot" Errors
+### Fixing "No Common Snapshot" Errors
This is the most common replication issue, typically occurring when:
@@ -777,7 +787,7 @@ paul@f0:~ % doas zrepl status --mode raw | grep -A10 "ZFSCmds.*Active"
paul@f0:~ % doas zrepl status --mode raw | grep BytesReplicated
```
-#### Network Connectivity Issues
+### Network Connectivity Issues
If replication fails to connect:
@@ -792,7 +802,7 @@ paul@f1:~ % doas netstat -an | grep 8888
paul@f0:~ % ping 192.168.2.131
```
-#### Encryption Key Issues
+### Encryption Key Issues
If encrypted replication fails:
@@ -806,7 +816,7 @@ paul@f1:~ % doas zfs load-key -L file:///keys/f0.lan.buetow.org:zdata.key \
zdata/sink/f0/zdata/enc/nfsdata
```
-#### Monitoring Ongoing Replication
+### Monitoring Ongoing Replication
After fixing issues, monitor replication health:
@@ -1193,13 +1203,13 @@ if [ ! -f /data/nfs/nfs.DO_NOT_REMOVE ]; then
zfs load-key -L file:///keys/f0.lan.buetow.org:zdata.key zdata/enc/nfsdata
zfs set mountpoint=/data/nfs zdata/enc/nfsdata
else
- doas zfs load-key -L file:///keys/f0.lan.buetow.org:zdata.key zdata/sink/f0/zdata/enc/nfsdata
- doas zfs set mountpoint=/data/nfs zdata/sink/f0/zdata/enc/nfsdata
- doas zfs mount zdata/sink/f0/zdata/enc/nfsdata
- doas zfs set readonly=on zdata/sink/f0/zdata/enc/nfsdata
+ zfs load-key -L file:///keys/f0.lan.buetow.org:zdata.key zdata/sink/f0/zdata/enc/nfsdata
+ zfs set mountpoint=/data/nfs zdata/sink/f0/zdata/enc/nfsdata
+ zfs mount zdata/sink/f0/zdata/enc/nfsdata
+ zfs set readonly=on zdata/sink/f0/zdata/enc/nfsdata
fi
- doas service nfsd stop 2>&1
- doas service mountd stop 2>&1
+ service nfsd stop 2>&1
+ service mountd stop 2>&1
fi
diff --git a/gemfeed/2025-12-07-f3s-kubernetes-with-freebsd-part-8.md b/gemfeed/2025-12-07-f3s-kubernetes-with-freebsd-part-8.md
index b62c4a2d..75fce4f5 100644
--- a/gemfeed/2025-12-07-f3s-kubernetes-with-freebsd-part-8.md
+++ b/gemfeed/2025-12-07-f3s-kubernetes-with-freebsd-part-8.md
@@ -467,7 +467,10 @@ spec:
- record: node_memory_MemTotal_bytes
expr: node_memory_size_bytes{os="freebsd"}
- record: node_memory_MemAvailable_bytes
- expr: node_memory_free_bytes{os="freebsd"} + node_memory_inactive_bytes{os="freebsd"} + node_memory_cache_bytes{os="freebsd"}
+ expr: |
+ node_memory_free_bytes{os="freebsd"}
+ + node_memory_inactive_bytes{os="freebsd"}
+ + node_memory_cache_bytes{os="freebsd"}
- record: node_memory_MemFree_bytes
expr: node_memory_free_bytes{os="freebsd"}
- record: node_memory_Buffers_bytes
@@ -574,7 +577,10 @@ spec:
labels:
os: openbsd
- record: node_memory_MemAvailable_bytes
- expr: node_memory_free_bytes{os="openbsd"} + node_memory_inactive_bytes{os="openbsd"} + node_memory_cache_bytes{os="openbsd"}
+ expr: |
+ node_memory_free_bytes{os="openbsd"}
+ + node_memory_inactive_bytes{os="openbsd"}
+ + node_memory_cache_bytes{os="openbsd"}
labels:
os: openbsd
- record: node_memory_MemFree_bytes