Exporting the NF Logs, Metrics, Traces, and Alerts Data

  1. Execute the following kubernetes job using helm to generate the data:

    The file that is created or updated is used in the helm file.

    helm install ocnf-data-exporter/ --name <helm-release> --namespace <k8s namespace> -f <exporter_customized_values.yaml>
    Where,
    • <helm-release> indicates the name provided by the user to identify the helm deployment.
    • <k8s namespace> indicates the name provided by the user to identify the kubernetes namespace of the utility. The job executes in this kubernetes namespace.
    Example:
    helm install ocnf-data-exporter/ --name ocnf-data-exporter --namespace ocnf-data-exporter -f exporter-custom-values.yaml
  2. Execute the following command to check the status of the job:
    helm status <helm-release>
    Example:
    helm status ocnf-data-exporter
  3. Execute the following command to check the status of the pods:
    kubectl get pods -n <k8s namespace>

    Ensure that the Status column of all the pods must be Running and the Ready column of all the pods must be n/n, where n indicates the number of containers in the pod.

    Example:

    kubectl get pods -n ocnf-data-exporter
    NAME                                      READY    STATUS    RESTARTS     AGE
    ocnf-data-exporter-dwdhwjw64vd3            3/3     Running     0          3m2s
    
  4. Execute the following command to check the completion of the job:
    kubectl get pods -n <k8s namespace>

    Ensure that the Status column of all the pods must be Complete and the Ready column of all the pods must be 0/n, where n indicates the number of containers in the pod.

    Example:

    kubectl get pods -n ocnf-data-exporter
    NAME                                      READY    STATUS     RESTARTS     AGE
    ocnf-data-exporter-dwdhwjw64vd3            0/3     Complete     0          3m2s

Result

The Exporter utility creates the exported-data_<current-date>_<current-time> directory in the specified path in the directory provided in the exporter-custom-values-<release number>.yaml file parameter global.outputPath.

Sample output:



[root@k8s-cluster-master tmp]# du -sh exported-data_2020-07-03_08:15:38/*
232K    exported-data_2020-07-03_08:15:38/logs
2.2G    exported-data_2020-07-03_08:15:38/metrics
88K     exported-data_2020-07-03_08:15:38/traces

[root@k8s-cluster-master tmp]# ls exported-data_2020-07-03_08:15:38/logs
jaeger-service-2020-06-28.json           jaeger-service-2020-07-02.settings.json  jaeger-span-2020-07-02.json           logstash-2020.06.28.template.json  logstash-2020.07.01.settings.json  logstash-2042.01.06.json
jaeger-service-2020-06-28.mapping.json   jaeger-service-2020-07-02.template.json  jaeger-span-2020-07-02.mapping.json   logstash-2020.06.29.mapping.json   logstash-2020.07.01.template.json  logstash-2042.01.06.mapping.json
jaeger-service-2020-06-28.settings.json  jaeger-span-2020-06-28.json              jaeger-span-2020-07-02.settings.json  logstash-2020.06.29.settings.json  logstash-2020.07.02.json           logstash-2042.01.06.settings.json
jaeger-service-2020-06-28.template.json  jaeger-span-2020-06-28.mapping.json      jaeger-span-2020-07-02.template.json  logstash-2020.06.29.template.json  logstash-2020.07.02.mapping.json   logstash-2042.01.06.template.json
jaeger-service-2020-06-30.json           jaeger-span-2020-06-28.settings.json     logstash-2020.06.27.json              logstash-2020.06.30.json           logstash-2020.07.02.settings.json  logstash-2062.01.03.json
jaeger-service-2020-06-30.mapping.json   jaeger-span-2020-06-28.template.json     logstash-2020.06.27.mapping.json      logstash-2020.06.30.mapping.json   logstash-2020.07.02.template.json  logstash-2062.01.03.mapping.json
jaeger-service-2020-06-30.settings.json  jaeger-span-2020-06-30.json              logstash-2020.06.27.settings.json     logstash-2020.06.30.settings.json  logstash-2020.07.03.json           logstash-2062.01.03.settings.json
jaeger-service-2020-06-30.template.json  jaeger-span-2020-06-30.mapping.json      logstash-2020.06.27.template.json     logstash-2020.06.30.template.json  logstash-2020.07.03.mapping.json   logstash-2062.01.03.template.json
jaeger-service-2020-07-02.json           jaeger-span-2020-06-30.settings.json     logstash-2020.06.28.mapping.json      logstash-2020.07.01.json           logstash-2020.07.03.settings.json
jaeger-service-2020-07-02.mapping.json   jaeger-span-2020-06-30.template.json     logstash-2020.06.28.settings.json     logstash-2020.07.01.mapping.json   logstash-2020.07.03.template.json

[root@k8s-cluster-master tmp]# ls exported-data_2020-07-03_08:15:38/metrics
metrics-dump_ThreadPoolExecutor-0_0.json   metrics-dump_ThreadPoolExecutor-0_16.json  metrics-dump_ThreadPoolExecutor-0_22.json  metrics-dump_ThreadPoolExecutor-0_29.json  metrics-dump_ThreadPoolExecutor-0_6.json
metrics-dump_ThreadPoolExecutor-0_10.json  metrics-dump_ThreadPoolExecutor-0_17.json  metrics-dump_ThreadPoolExecutor-0_23.json  metrics-dump_ThreadPoolExecutor-0_2.json   metrics-dump_ThreadPoolExecutor-0_7.json
metrics-dump_ThreadPoolExecutor-0_11.json  metrics-dump_ThreadPoolExecutor-0_18.json  metrics-dump_ThreadPoolExecutor-0_24.json  metrics-dump_ThreadPoolExecutor-0_30.json  metrics-dump_ThreadPoolExecutor-0_8.json
metrics-dump_ThreadPoolExecutor-0_12.json  metrics-dump_ThreadPoolExecutor-0_19.json  metrics-dump_ThreadPoolExecutor-0_25.json  metrics-dump_ThreadPoolExecutor-0_31.json  metrics-dump_ThreadPoolExecutor-0_9.json
metrics-dump_ThreadPoolExecutor-0_13.json  metrics-dump_ThreadPoolExecutor-0_1.json   metrics-dump_ThreadPoolExecutor-0_26.json  metrics-dump_ThreadPoolExecutor-0_3.json
metrics-dump_ThreadPoolExecutor-0_14.json  metrics-dump_ThreadPoolExecutor-0_20.json  metrics-dump_ThreadPoolExecutor-0_27.json  metrics-dump_ThreadPoolExecutor-0_4.json
metrics-dump_ThreadPoolExecutor-0_15.json  metrics-dump_ThreadPoolExecutor-0_21.json  metrics-dump_ThreadPoolExecutor-0_28.json  metrics-dump_ThreadPoolExecutor-0_5.json

[root@k8s-cluster-master tmp]# ls exported-data_2020-07-03_08:15:38/traces
jaeger-service-2020-06-28.json           jaeger-service-2020-06-30.json           jaeger-service-2020-07-02.json           jaeger-span-2020-06-28.json           jaeger-span-2020-06-30.json           jaeger-span-2020-07-02.json
jaeger-service-2020-06-28.mapping.json   jaeger-service-2020-06-30.mapping.json   jaeger-service-2020-07-02.mapping.json   jaeger-span-2020-06-28.mapping.json   jaeger-span-2020-06-30.mapping.json   jaeger-span-2020-07-02.mapping.json
jaeger-service-2020-06-28.settings.json  jaeger-service-2020-06-30.settings.json  jaeger-service-2020-07-02.settings.json  jaeger-span-2020-06-28.settings.json  jaeger-span-2020-06-30.settings.json  jaeger-span-2020-07-02.settings.json
jaeger-service-2020-06-28.template.json  jaeger-service-2020-06-30.template.json  jaeger-service-2020-07-02.template.json  jaeger-span-2020-06-28.template.json  jaeger-span-2020-06-30.template.json  jaeger-span-2020-07-02.template.json