I am adding a function to our existing Laravel application managing financial transaction related data. Each week we are getting the data in csv files using the below given predefined format. I am wondering which approach I should use to load that data into the database
- Should I load the csv data straight into a single table using same fields in the csv format? or;
- Should I split the table into originators, and destination?
e.g. csv format: transaction_id, date, Originator, origin_id, currency, amount, destination, destination_id,
This is especially important considering that in the end of the day, users will need to search for entities and their associations using an ID number or entity name
If it helps, we get millions of records in each csv file often with same individuals and entities repeating on either side of the transaction.
Thanks in advance :)
via Chebli Mohamed
Aucun commentaire:
Enregistrer un commentaire