Most Challenging Works
Hardware:
AWS Cloud:
Web App:
- We need to create a profile for every food in the fridge. It requires us to distinguish every food in the environment.
- We need to determine the user’s action is taking food out, putting food in or just checking what we have in the fridge.
AWS Cloud:
- By means of AWS Rekognition, we are able to fulfill the image detection. However, for a given food image, Rekognition returns a list of all possible labels, but we merely need the most proper one. Specifically, for a clear input apple image, Rekognition gives an answer containing labels “Food”, “Fruit”, “Plant”, “Apple”, … We do not want the item be tagged as “Fruit”, instead we want it to be labeled as “Apple”.
- Suppose we have successfully and correctly detect an apple. How do we get nutrition information about the apple? Specifically, it is not easy to directly determine the calories in the apple as well as the expected expiration date of it.
Web App:
- Data transmission is the most difficult part in the App development. When the front end part uses axios to request POST data to the back end, it triggers cross-domain problem because the port numbers or the ip addresses are not the same.
- Also, refresh page to request the updated data is hard because it takes some time to read the updated information in the DynamoDB, and it needs an asynchronous function when reading new data, or the data might not have enough time to be updated.