Convery yaml array to string array

Question

I have a yq read command as below,

groups=$(yq read  generated/identity-mapping.yaml "iamIdentityMappings.[0].groups")

It reads iamIdentityMappings from below yaml:

iamIdentityMappings:
- groups:
  - Appdeployer
  - Moregroups

It stores group as below,

- Appdeployer
- Moregroups

But I want to store groups as below.(comma separated values)

groups="Appdeployer","Moregroups"

How to do this in bash?

Are you sure you don't want to use a native bash array instead? For that, convert to json (which we know from other questions that you already know how to do) and use readarray/mapfile with jq as given in stackoverflow.com/questions/35005893/… — Charles Duffy
– Charles Duffy, Commented Jul 16, 2020 at 2:07
Sorry..not sure what you mean by native bash array..But I want as comma separated values so I can pass it in one eksctl command..Only this csv is working — Rad4
– Rad4, Commented Jul 16, 2020 at 2:09
I'd need to know what the command you're calling is to know if that actually is the right tool for the job. Strings are not arrays, and pretending that they are is a common source of bugs. See BashFAQ #5. — Charles Duffy
– Charles Duffy, Commented Jul 16, 2020 at 2:10
That said, if you set IFS=,, "${somearray[*]}" will convert a native bash array to a comma-separated string, which it sounds like is what you want. — Charles Duffy
– Charles Duffy, Commented Jul 16, 2020 at 2:13
Does this answer your question? Construct a command based upon a count variable in bash — user1934428
– user1934428, Commented Jul 16, 2020 at 6:06

Mike Farah · Accepted Answer · 2021-12-05 01:32:55Z

3

yq 4.16+ now has a built in @csv operator:

yq e '.iamIdentityMappings.[0].groups | @csv' file.yaml

Note that @csv will only wrap values in quotes if needed (e.g. they have a comma).

If you want quotes, then sub then in and join with commas:

yq e '
   .iamIdentityMappings.[0].groups | 
   (.[] |= sub("(.*)", "\"${1}\"")) 
   | join(",")'

Disclaimer: I wrote yq.

edited Dec 5, 2021 at 1:32

answered Dec 5, 2021 at 1:25

Mike Farah

2,71426 silver badges22 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Shawn · Accepted Answer · 2020-07-16 02:53:06Z

2

yq is just a wrapper for jq, which supports CSV output:

$ groups="$(yq -r '.iamIdentifyMappings[0].groups | @csv' generated/identity-mapping.yaml)"
$ echo "$groups"
"Appdeployer","Moregroups"

The yq invocation in your question just causes an error. Note the fixed version.

answered Jul 16, 2020 at 2:53

Shawn

53.9k3 gold badges29 silver badges74 bronze badges

2 Comments

Charles Duffy Over a year ago

There are two different programs named yq, and their usage is different. The OP is using the one written in Go, not the one written in Python.

Shawn Over a year ago

@CharlesDuffy Huh. That's annoying.

Léa Gris · Accepted Answer · 2020-07-16 06:08:59Z

Use mapfile and format a null delimited list with yq:

mapfile -d '' -t groups < <(
  yq -j '.iamIdentityMappings[0].groups[]+"\u0000"' \
  generated/identity-mapping.yaml
)
typeset -p groups

Output:

declare -a groups=([0]="Appdeployer" [1]="Moregroups")

And now you can fulfill this second part of your question: Construct a command based upon a count variable in bash

# Prepare eksctl's arguments into an array
declare -a eksctl_args=(create iamidentitymapping --cluster "$name" --region "$region" --arn "$rolearn" )

# Read the groups from the yml into an array
mapfile -d '' -t groups < <(
  yq -j '.iamIdentityMappings[0].groups[]+"\u0000"' \
  generated/identity-mapping.yaml
)

# Add arguments per group
for group in "${groups[@]}"; do
  eksctl_args+=(--group "$group")
done

# add username argument
eksctl_args+=(--username "$username")

# call eksctl with its arguments
eksctl "${eksctl_args[@]}"

mbr1411 · Accepted Answer · 2021-02-18 01:04:39Z

0

yq version 3 is deprecated now and you can achieve the same output using version 4

#!/bin/bash

while IFS= read -r value; do
    groups_array+=($value)
done < <(yq eval '.iamIdentityMappings.[0].groups.[]' generated/identity-mapping.yaml)

printf -v comma_seperated '%s,' "${groups_array[@]}"
echo "${comma_seperated%,}"

This code prints the comma seperated values as you wanted

answered Feb 18, 2021 at 1:04

mbr1411

11 bronze badge

Collectives™ on Stack Overflow

Convery yaml array to string array

4 Answers 4

Comments

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related