☰

jq: creación de un filtro para salida csv

tag-icon • tag-icon text-formatting jq
jq: creación de un filtro para salida csv

Tengo el siguiente archivo JSON:

{
"result": [
{
  "hostid": "12607",
  "name": "love",
  "host": "loveyou",
  "status": "0",
  "groups": [
    {
      "groupid": "47",
      "name": "Flower"
    },
    {
      "groupid": "145",
      "name": "Sun"
    }
  ],
  "triggers": [
    {
      "triggerid": "211498",
      "description": "The host is unavailable by ICMP",
      "status": "0"
    },
    {
      "triggerid": "211499",
      "description": "CPU load above {$CPU}% ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211500",
      "description": "The host has just been restarted (SysUptime {ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211501",
      "description": "Sem resposta SNMP. Community {$SNMP_COMMUNITY}",
      "status": "0"
    },
    {
      "triggerid": "211574",
      "description": "Memory Usage is over {$MEM}% ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211575",
      "description": "Free disk space is less than {$DISK}% on volume C:\\\\ Label:  Serial Number 1ab4e15c ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211576",
      "description": "Free disk space is less than {$DISK}% on volume E:\\\\ Label:NETAPP_LUN_01  Serial Number 84048285 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211577",
      "description": "Free disk space is less than {$DISK}% on volume F:\\\\ Label:NETAPP_LUN_02  Serial Number 6426fd9 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211578",
      "description": "Free disk space is less than {$DISK}% on volume G:\\\\ Label:NETAPP_LUN_03  Serial Number 184b60f9 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211579",
      "description": "Free disk space is less than {$DISK}% on volume H:\\\\ Label:NETAPP_LUN_04  Serial Number 88541457 ({ITEM.LASTVALUE})",
      "status": "0"
    },
    {
      "triggerid": "211580",
      "description": "Free disk space is less than {$DISK}% on volume I:\\\\ Label:NETAPP_LUN_07  Serial Number f23669bc ({ITEM.LASTVALUE})",
      "status": "0"
    }
  ],
  "interfaces": [
    {
      "interfaceid": "2394",
      "ip": "192.168.1.190"
    },
    {
      "interfaceid": "2399",
      "ip": "192.168.1.190"
    }
  ]
}

Me gustaría tener un archivo CSV en este formato:

NAME, GROUP, IP,           DESCRIPTION
love, Sun, 192.168.1.190, The host is unavailable by ICMP
love, Sun, 192.168.1.190 , CPU load above {$CPU}% ({ITEM.LASTVALUE})
love, Sun, 192.168.1.190 , The host has just been restarted

¿Es esto posible usando solo jq?

Usé junto con jq el comando sed:

CLIENTE=`echo "$RESULT" | jq -r .result[].groups[].name | sort | grep -m1 Cliente`
VISIBLENAME=`echo "$RESULT" | jq -r .result[].name | sed 's/ //g'`
HOST=`echo "$RESULT" | jq -r .result[].host | sed 's/ /_/g'`
IP=`echo "$RESULT" | jq -r .result[].interfaces[0].ip`
TRIGGERS=`echo "$RESULT" | jq -r .result[].triggers[].description | sed 's/ /_/g'`
TRIGSTATUS=`echo "$RESULT" | jq -r .result[].triggers[].status | sed 's/0/enabled/g;s/1/disabled/g'`
PRIORITY=`echo "$RESULT" | jq -r .result[].triggers[].priority | sed 's/0/notclassified/g;s/1/information/g;s/2/warning/g;s/3/average/g;s/4/high/g;s/5/disaster/g'`
ACTIVEHOST=`echo "$RESULT" | jq -r .result[].status | sed 's/0/monitored/g;s/1/unmonitored/g'`
TSTATUS=`paste <(echo "$TRIGGERS") <(echo "$TRIGSTATUS") <(echo "$PRIORITY")| sed 's/[[:space:]]/;/g'

echo "$CLIENTE;$VISIBLENAME;$HOST;$IP;$j;$ACTIVEHOST";

Respuesta1

Sí, de hecho esmás fácilpara hacerlo solo en JQ. Debe crear la fila que desea como una matriz, usando filtros JQ, y luego usar el @csvfiltro para generar la fila en formato CSV (además de -rque el CSV no tenga escape JSON adicional).

No tengo claro exactamente cuáles son sus requisitos, ya que su código realmente no coincide con el resultado del ejemplo y no es obvio qué hacer con los datos repetidos/anidados, pero aquí hay un ejemplo que funciona parcialmente:

jq -r '.result[] | . as $result 
  | .triggers[] 
  | [$result.name, $result.groups[0].name, $result.interfaces[0].ip, .description] 
  | @csv'

que, dados los datos de su prueba, genera

"love","Flower","192.168.1.190","The host is unavailable by ICMP"
"love","Flower","192.168.1.190","CPU load above {$CPU}% ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","The host has just been restarted (SysUptime {ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Sem resposta SNMP. Community {$SNMP_COMMUNITY}"
"love","Flower","192.168.1.190","Memory Usage is over {$MEM}% ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume C:\\ Label:  Serial Number 1ab4e15c ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume E:\\ Label:NETAPP_LUN_01  Serial Number 84048285 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume F:\\ Label:NETAPP_LUN_02  Serial Number 6426fd9 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume G:\\ Label:NETAPP_LUN_03  Serial Number 184b60f9 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume H:\\ Label:NETAPP_LUN_04  Serial Number 88541457 ({ITEM.LASTVALUE})"
"love","Flower","192.168.1.190","Free disk space is less than {$DISK}% on volume I:\\ Label:NETAPP_LUN_07  Serial Number f23669bc ({ITEM.LASTVALUE})"

La cita es más de lo que solicitó, pero es un CSV completamente válido.

información relacionada