How to read a CSV or a INI file with Bash

About

How to parse a CSV or property (ini) in bash

Snippet

Ini

DIR_PATH="."
FILE_PATTERN="*.ini"
for FILE in ${DIR_PATH}/${FILE_PATTERN}; do

	FILENAME=$(basename ${FILE})
	echo "Reading ${FILENAME}"

	OLD_IFS=$IFS; IFS=$'\n';
	while IFS="=" read -r PROP_KEY PROP_VALUE || [[ -n "$PROP_KEY" ]]; do

		echo "Prop Key:(${PROP_KEY}), (${PROP_VALUE})"

	done < ${FILE}
	IFS=${OLD_IFS}

done

where:

• the first FOR iterate over a list of ini file in the current directory.
• the while read:
  • reads a line of ${FILE} until it finds an EOF
  • parse it with the separator character specified with Bash - IFS (Field Separator) IFS=“=”
  • and set the consecutive variable PROP_KEY and PROP_VALUE
  • without using \ as escape character because of the r option -r
• || [[ -n "$PROP_KEY" ]] permits to read the last line even without end of line

Csv

DIR_PATH="."
FILE_PATTERN="*.csv"
for FILE in ${DIR_PATH}/${FILE_PATTERN}; do

	FILENAME=$(basename ${FILE})
	echo "Reading ${FILENAME}"

	OLD_IFS=$IFS; IFS=$'\n';
        # Adapt to the number of col. Below you have 3
	while IFS="," read -r COL1 COL2 COL3 || [[ -n "$COL1" ]]; do

		echo "${COL1}, ${COL2}, ${COL3}"

	done < ${FILE}
	IFS=${OLD_IFS}

done

Documentation / Reference

• Adapated from https://stackoverflow.com/questions/10929453/read-a-file-line-by-line-assigning-the-value-to-a-variable