flb // vmetrics

install | vmetrics | metrics injection | dashboard and acceptance

requirements

make sure the prometheus-like service – here vmetrics – is reachable

vmetrics=x.x.x.x

nmap -p 8428 $vmetrics

as well as the remote write api

curl -I http://$vmetrics:8428/api/v1/write

flb setup

cd /etc/fluent-bit/
mv -i fluent-bit.conf fluent-bit.conf.dist

# https://pub.nethence.com/bin/monitoring/fluent-bit.conf.vmetrics
vi fluent-bit.conf

ready to go

tail -F /var/log/fluent-bit*log

systemctl restart fluent-bit
systemctl status fluent-bit
journalctl -xeu fluent-bit

acceptance

avg_over_time(log_metric_gauge_cpu_p[5m])

see dashboard and acceptance

resources

inputs

https://docs.fluentbit.io/manual/pipeline/inputs/cpu-metrics

https://docs.fluentbit.io/manual/pipeline/inputs/memory-metrics

https://docs.fluentbit.io/manual/pipeline/inputs/disk-io-metrics

https://docs.fluentbit.io/manual/pipeline/inputs/network-io-metrics

tsdb export

https://docs.fluentbit.io/manual/pipeline/inputs/node-exporter-metrics

https://docs.fluentbit.io/manual/pipeline/filters/log_to_metrics

https://docs.fluentbit.io/manual/pipeline/outputs/prometheus-remote-write

vmetrics

https://docs.victoriametrics.com/Cluster-VictoriaMetrics.html ==> http://:8480/insert//prometheus/api/v1/write

https://docs.victoriametrics.com/keyConcepts.html#instant-query

https://docs.victoriametrics.com/#prometheus-setup

https://docs.victoriametrics.com/Single-server-VictoriaMetrics.html#prometheus-setup

prometheus

https://prometheus.io/docs/concepts/jobs_instances/

https://prometheus.io/docs/practices/remote_write/

troubles

https://github.com/fluent/fluent-bit/issues/5501

moar

https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/README.md#how-to-import-data-in-native-format

https://github.com/VictoriaMetrics/VictoriaMetrics/blob/master/README.md#sending-data-via-opentelemetry

https://docs.victoriametrics.com/#how-to-scrape-prometheus-exporters-such-as-node-exporter