mirror of
https://github.com/mainflux/mainflux.git
synced 2025-04-28 13:48:49 +08:00
23bc094ec3
* Add Async Consumer Support Author: aryan <aryangodara03@gmail.com> Signed-off-by: dusanb94 <dusan.borovcanin@mainflux.com> * update consumer_async, fix flush interval Signed-off-by: aryan <aryangodara03@gmail.com> * update influxdb from 1.4.0 to 2.12.3 Signed-off-by: aryan <aryangodara03@gmail.com> * separate tests and update logging and metrics middlewares Signed-off-by: aryan <aryangodara03@gmail.com> * fix typos and comments Signed-off-by: aryan <aryangodara03@gmail.com> * fix interfaces and tests Signed-off-by: aryan <aryangodara03@gmail.com> * fix interface and add docs Signed-off-by: aryan <aryangodara03@gmail.com> * update Consumer interface godoc Signed-off-by: aryan <aryangodara03@gmail.com> * update influx-writer logger Signed-off-by: aryan <aryangodara03@gmail.com> --------- Signed-off-by: dusanb94 <dusan.borovcanin@mainflux.com> Signed-off-by: aryan <aryangodara03@gmail.com> Co-authored-by: dusanb94 <dusan.borovcanin@mainflux.com>
Postgres writer
Postgres writer provides message repository implementation for Postgres.
Configuration
The service is configured using the environment variables presented in the following table. Note that any unset variables will be replaced with their default values.
| Variable | Description | Default |
|---|---|---|
| MF_BROKER_URL | Message broker instance URL | nats://localhost:4222 |
| MF_POSTGRES_WRITER_LOG_LEVEL | Service log level | info |
| MF_POSTGRES_WRITER_PORT | Service HTTP port | 9010 |
| MF_POSTGRES_WRITER_DB_HOST | Postgres DB host | postgres |
| MF_POSTGRES_WRITER_DB_PORT | Postgres DB port | 5432 |
| MF_POSTGRES_WRITER_DB_USER | Postgres user | mainflux |
| MF_POSTGRES_WRITER_DB_PASS | Postgres password | mainflux |
| MF_POSTGRES_WRITER_DB | Postgres database name | messages |
| MF_POSTGRES_WRITER_DB_SSL_MODE | Postgres SSL mode | disabled |
| MF_POSTGRES_WRITER_DB_SSL_CERT | Postgres SSL certificate path | "" |
| MF_POSTGRES_WRITER_DB_SSL_KEY | Postgres SSL key | "" |
| MF_POSTGRES_WRITER_DB_SSL_ROOT_CERT | Postgres SSL root certificate path | "" |
| MF_POSTGRES_WRITER_CONFIG_PATH | Config file path with Message broker subjects list, payload type and content-type | /config.toml |
Deployment
The service itself is distributed as Docker container. Check the postgres-writer service section in docker-compose to see how service is deployed.
To start the service, execute the following shell script:
# download the latest version of the service
git clone https://github.com/mainflux/mainflux
cd mainflux
# compile the postgres writer
make postgres-writer
# copy binary to bin
make install
# Set the environment variables and run the service
MF_BROKER_URL=[Message broker instance URL] \
MF_POSTGRES_WRITER_LOG_LEVEL=[Service log level] \
MF_POSTGRES_WRITER_PORT=[Service HTTP port] \
MF_POSTGRES_WRITER_DB_HOST=[Postgres host] \
MF_POSTGRES_WRITER_DB_PORT=[Postgres port] \
MF_POSTGRES_WRITER_DB_USER=[Postgres user] \
MF_POSTGRES_WRITER_DB_PASS=[Postgres password] \
MF_POSTGRES_WRITER_DB=[Postgres database name] \
MF_POSTGRES_WRITER_DB_SSL_MODE=[Postgres SSL mode] \
MF_POSTGRES_WRITER_DB_SSL_CERT=[Postgres SSL cert] \
MF_POSTGRES_WRITER_DB_SSL_KEY=[Postgres SSL key] \
MF_POSTGRES_WRITER_DB_SSL_ROOT_CERT=[Postgres SSL Root cert] \
MF_POSTGRES_WRITER_CONFIG_PATH=[Config file path with Message broker subjects list, payload type and content-type] \
$GOBIN/mainflux-postgres-writer
Usage
Starting service will start consuming normalized messages in SenML format.