# Fluent Bit API for Ingesting Custom Logs

Kloudfuse can ingest logs from Fluent Bit API agent payloads. You would have to add rules and custom configurations in `custom-values.yaml` in Kloudfuse.

## Basic Payload

A logs payload from Fluent Bit API looks similar to the following example:

### Ingesting Fluent Bit API Logs Payload

```json
 [
  {  
    'k1':'foo',
    'k2': 'bar',
    'source': 'app1',
    'msg': json.dumps(parsed_payload[0]),
    'date': time.time()
  },
  {  
    'k1':'baz',
    'k2': 'bat',
    'source': 'app2',
    'msg': json.dumps(parsed_payload[1]),
    'date': time.time()
  }
]
```

|     |     |
| --- | --- |
| **1** | The `'msg'` key contains the actual log line. |
| **2** | The `'date'` key contains the timestamp to attach to the log line. |

## Enrich Logs During Ingestion

You can configure Kloudfuse ingestion to extract and enrich logs. Consider the following `logs-parser` rule that instructs Kloudfuse to extract important attributes from the JSON code:

### Configure Log Enrichment

```yaml
 logs-parser
   parsing_config:
    - remap:
        args:
          kf_source:
            - "$.source"
          kf_additional_tags:
            - "$.k1"
            - "$.k2"
```

|     |     |
| --- | --- |
| **1** | The `remap` rule instructs Kloudfuse to implement the following details. |
| **2** | Extracts from the `source` field in the incoming JSON payload. |
| **3** | Extracts `k1` and `k2` as labels from the JSON payload. |

## Attach Labels from HTTP Headers

You can send custom labels as HTTP headers, along with the incoming payload. Consider the following `ingester config`:

```yaml
ingester:
  config:
    labelsFromHeaders:
      X-KFUSE-ENV: "env"
      X-KFUSE-CUSTOM: "custom_key_1"
```

|     |     |
| --- | --- |
| **1** | Informs Kloudfuse to look for `X-KFUSE-ENV` and `X-KFUSE-CUSTOM` in HTTP headers of incoming logs. |

When Kloudfuse finds the matching headers, it renames the labels inside them to the new name, and attaches the values that delivered by the payload. In this example, the header `X-KFUSE-ENV': 'prod` will be renamed to the label `env` with value `prod`, `env:prod`.