1
0
mirror of https://github.com/mainflux/mainflux.git synced 2025-04-26 13:48:53 +08:00
Dušan Borovčanin f50335ab33 MF-919 - Mainflux message updates (#924)
* Remove RawMessage

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove Normalizer

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Update tests

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Replace normalizer with senml-transformer

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Rename Transformer interface and package

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Update docs

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove SenML transformer service

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove SenML Protobuf support

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix readers

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix writers tests

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Refactor tests and remove normalizer

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Update docs

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Reanme Service interface to Transformer

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Use msg instead of rawmsg

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove rawMsg from Aedes code

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix VerneMQ files

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove RawMessage code

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix missing subtopic return

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Remove remaining RawMessage reference

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix formatting

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix readers and writers tests

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Rename SenML transformer variables

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>

* Fix readers and writers tests constants

Signed-off-by: Dušan Borovčanin <dusan.borovcanin@mainflux.com>
2019-11-05 11:57:16 +01:00
..

Postgres reader

Postgres reader provides message repository implementation for Postgres.

Configuration

The service is configured using the environment variables presented in the following table. Note that any unset variables will be replaced with their default values.

Variable Description Default
MF_THINGS_URL Things service URL things:8183
MF_POSTGRES_READER_LOG_LEVEL Service log level debug
MF_POSTGRES_READER_PORT Service HTTP port 9204
MF_POSTGRES_READER_CLIENT_TLS TLS mode flag false
MF_POSTGRES_READER_CA_CERTS Path to trusted CAs in PEM format
MF_POSTGRES_READER_DB_HOST Postgres DB host postgres
MF_POSTGRES_READER_DB_PORT Postgres DB port 5432
MF_POSTGRES_READER_DB_USER Postgres user mainflux
MF_POSTGRES_READER_DB_PASS Postgres password mainflux
MF_POSTGRES_READER_DB_NAME Postgres database name messages
MF_POSTGRES_READER_DB_SSL_MODE Postgres SSL mode disabled
MF_POSTGRES_READER_DB_SSL_CERT Postgres SSL certificate path ""
MF_POSTGRES_READER_DB_SSL_KEY Postgres SSL key ""
MF_POSTGRES_READER_DB_SSL_ROOT_CERT Postgres SSL root certificate path ""
MF_JAEGER_URL Jaeger server URL localhost:6831
MF_POSTGRES_READER_THINGS_TIMEOUT Things gRPC request timeout in seconds 1

Deployment

  version: "3.7"
  postgres-writer:
    image: mainflux/postgres-writer:[version]
    container_name: [instance name]
    depends_on:
      - postgres
      - nats
    restart: on-failure
    environment:
      MF_NATS_URL: [NATS instance URL]
      MF_POSTGRES_READER_LOG_LEVEL: [Service log level]
      MF_POSTGRES_READER_PORT: [Service HTTP port]
      MF_POSTGRES_READER_DB_HOST: [Postgres host]
      MF_POSTGRES_READER_DB_PORT: [Postgres port]
      MF_POSTGRES_READER_DB_USER: [Postgres user]
      MF_POSTGRES_READER_DB_PASS: [Postgres password]
      MF_POSTGRES_READER_DB_NAME: [Postgres database name]
      MF_POSTGRES_READER_DB_SSL_MODE: [Postgres SSL mode]
      MF_POSTGRES_READER_DB_SSL_CERT: [Postgres SSL cert]
      MF_POSTGRES_READER_DB_SSL_KEY: [Postgres SSL key]
      MF_POSTGRES_READER_DB_SSL_ROOT_CERT: [Postgres SSL Root cert]
      MF_JAEGER_URL: [Jaeger server URL]
      MF_POSTGRES_READER_THINGS_TIMEOUT: [Things gRPC request timeout in seconds]
    ports:
      - 8903:8903
    networks:
      - docker_mainflux-base-net

To start the service, execute the following shell script:

# download the latest version of the service
go get github.com/mainflux/mainflux


cd $GOPATH/src/github.com/mainflux/mainflux

# compile the postgres writer
make postgres-writer

# copy binary to bin
make install

# Set the environment variables and run the service
MF_THINGS_URL=[Things service URL] MF_POSTGRES_READER_LOG_LEVEL=[Service log level] MF_POSTGRES_READER_PORT=[Service HTTP port] MF_POSTGRES_READER_CLIENT_TLS =[TLS mode flag] MF_POSTGRES_READER_CA_CERTS=[Path to trusted CAs in PEM format] MF_POSTGRES_READER_DB_HOST=[Postgres host] MF_POSTGRES_READER_DB_PORT=[Postgres port] MF_POSTGRES_READER_DB_USER=[Postgres user] MF_POSTGRES_READER_DB_PASS=[Postgres password] MF_POSTGRES_READER_DB_NAME=[Postgres database name] MF_POSTGRES_READER_DB_SSL_MODE=[Postgres SSL mode] MF_POSTGRES_READER_DB_SSL_CERT=[Postgres SSL cert] MF_POSTGRES_READER_DB_SSL_KEY=[Postgres SSL key] MF_POSTGRES_READER_DB_SSL_ROOT_CERT=[Postgres SSL Root cert] MF_JAEGER_URL=[Jaeger server URL] MF_POSTGRES_READER_THINGS_TIMEOUT=[Things gRPC request timeout in seconds] $GOBIN/mainflux-postgres-reader

Usage

Starting service will start consuming normalized messages in SenML format.