improve the preprocessing to include new data

Modify the preprocessing step to include more data with. data generator, and adhere to ARCO for the future data preparation.

Task todo:

• 1. adopt the regrading script to apply to any datasets
• 2. refactor the preprocessing step to be only ARCOfication, based on the variables.
• 3. Test the chinking and read function