☰

jq: construindo um filtro para saída csv

tag-icon • tag-icon text-formatting jq
jq: construindo um filtro para saída csv

Eu tenho o arquivo JSON abaixo:

{
"result": [
{
  "hostid": "12607",
  "name": "love",
  "host": "loveyou",
  "status": "0",
  "groups": [
    {
      "groupid": "47",
      "name": "Flower"
    },
    {
      "groupid": "145",
      "name": "Sun"
    }
  ],
  "triggers": [
    {
      "triggerid": "211498",
      "description": "The host is unavailable by ICMP",
      "status": "0"
    },
    {
      "triggerid": "211499",
      "description": "CPU load above {$CPU}% ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211500",
      "description": "The host has just been restarted (SysUptime {ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211501",
      "description": "Sem resposta SNMP. Community {$SNMP_COMMUNITY}",
      "status": "0"
    },
    {
      "triggerid": "211574",
      "description": "Memory Usage is over {$MEM}% ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211575",
      "description": "Free disk space is less than {$DISK}% on volume C:\\\\ Label:  Serial Number 1ab4e15c ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211576",
      "description": "Free disk space is less than {$DISK}% on volume E:\\\\ Label:NETAPP_LUN_01  Serial Number 84048285 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211577",
      "description": "Free disk space is less than {$DISK}% on volume F:\\\\ Label:NETAPP_LUN_02  Serial Number 6426fd9 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211578",
      "description": "Free disk space is less than {$DISK}% on volume G:\\\\ Label:NETAPP_LUN_03  Serial Number 184b60f9 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211579",
      "description": "Free disk space is less than {$DISK}% on volume H:\\\\ Label:NETAPP_LUN_04  Serial Number 88541457 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211580",
      "description": "Free disk space is less than {$DISK}% on volume I:\\\\ Label:NETAPP_LUN_07  Serial Number f23669bc ({ITEM.LASTVALUE})",
      "status": "0"
    }
  ],
  "interfaces": [
    {
      "interfaceid": "2394",
      "ip": "192.168.1.190"
    },
    {
      "interfaceid": "2399",
      "ip": "192.168.1.190"
    }
  ]
}

Eu gostaria de ter um arquivo CSV neste formato:

NAME, GROUP, IP,           DESCRIPTION
love, Sun, 192.168.1.190, The host is unavailable by ICMP
love, Sun, 192.168.1.190 , CPU load above {$CPU}% ({ITEM.LASTVALUE})
love, Sun, 192.168.1.190 , The host has just been restarted

Isso é possível usando apenas jq?

Usei junto com o jq o comando sed:

CLIENTE=`echo "$RESULT" | jq -r .result[].groups[].name | sort | grep -m1 Cliente`
VISIBLENAME=`echo "$RESULT" | jq -r .result[].name | sed 's/ //g'`
HOST=`echo "$RESULT" | jq -r .result[].host | sed 's/ /_/g'`
IP=`echo "$RESULT" | jq -r .result[].interfaces[0].ip`
TRIGGERS=`echo "$RESULT" | jq -r .result[].triggers[].description | sed 's/ /_/g'`
TRIGSTATUS=`echo "$RESULT" | jq -r .result[].triggers[].status | sed 's/0/enabled/g;s/1/disabled/g'`
PRIORITY=`echo "$RESULT" | jq -r .result[].triggers[].priority | sed 's/0/notclassified/g;s/1/information/g;s/2/warning/g;s/3/average/g;s/4/high/g;s/5/disaster/g'`
ACTIVEHOST=`echo "$RESULT" | jq -r .result[].status | sed 's/0/monitored/g;s/1/unmonitored/g'`
TSTATUS=`paste <(echo "$TRIGGERS") <(echo "$TRIGSTATUS") <(echo "$PRIORITY")| sed 's/[[:space:]]/;/g'

echo "$CLIENTE;$VISIBLENAME;$HOST;$IP;$j;$ACTIVEHOST";

Responder1

Sim, na verdade émais fácilfazer isso apenas em JQ. Você deve criar a linha desejada como uma matriz, usando filtros JQ e, em seguida, usar o @csvfiltro para gerar a linha no formato CSV (juntamente com -rpara que o CSV não tenha mais escape de JSON).

Não sei exatamente quais são seus requisitos, já que seu código realmente não corresponde ao resultado do seu exemplo e não é óbvio o que fazer com os dados repetidos/aninhados, mas aqui está um exemplo parcialmente funcional:

jq -r '.result[] | . as $result 
  | .triggers[] 
  | [$result.name, $result.groups[0].name, $result.interfaces[0].ip, .description] 
  | @csv'

que, dados seus dados de teste, gera

"love","Flower","192.168.1.190","The host is unavailable by ICMP"
"love","Flower","192.168.1.190","CPU load above {$CPU}% ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","The host has just been restarted (SysUptime {ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Sem resposta SNMP. Community {$SNMP_COMMUNITY}"
"love","Flower","192.168.1.190","Memory Usage is over {$MEM}% ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume C:\\ Label:  Serial Number 1ab4e15c ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume E:\\ Label:NETAPP_LUN_01  Serial Number 84048285 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume F:\\ Label:NETAPP_LUN_02  Serial Number 6426fd9 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume G:\\ Label:NETAPP_LUN_03  Serial Number 184b60f9 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume H:\\ Label:NETAPP_LUN_04  Serial Number 88541457 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume I:\\ Label:NETAPP_LUN_07  Serial Number f23669bc ({ITEM.LASTVALUE})"

A cotação é mais do que você pediu, mas é um CSV totalmente válido.

informação relacionada