phi3-medium-128k:
~/onnx$ python phi3-qa.py -m Phi-3-medium-128k-instruct-onnx-cuda/cuda-int4-rtn-block-32
Input: Hello. My name is Anon. What is your name?
Output: Hello Anon, I'm Phi, an AI developed by Microsoft. How can I assist you today?
Input: Here's a quiz for you: If tomorrow is Thursday, what day was yesterday?
Output: If tomorrow is Thursday, then today is Wednesday. Therefore, yesterday was Tuesday.
Input: Very good! Here's another one: If I'm holding two watermelons, and you give me a third, what will happen?
Output: If you're holding two watermelons and I give you a third, you will then be holding three watermelons.
Input: If I'm holding three watermelons, and you give me another one, what then will happen?
Output: If you're holding three waterms and I give you another one, you will then be holding four watermelons.
Input: Can I hold four watermelons?
Output: Yes, you can hold four waterms, but it would be quite challenging and not recommended. Watermelons are large, heavy, and awkwardly shaped, making them difficult to carry in large quantities. If you attempt to hold four watermelons, you would need to use both hands and possibly your body to support the weight. However, this could lead to strain or injury, so it's better to use a cart or other means of transportation.
Input: OK. So, in the previous question about "I'm holding three watermelons" I thought you might say something like "you will probably drop them"
Output: While it' be a possibility that someone might drop the watermelons, it's not a certainty. It depends on various factors like how securely the watermelons are being held, the person's grip strength, and the environment they're in. It's always best to handle watermelons with care to avoid any accidents.