First of all, I apologize for the sloppy scripting, I'm 71 years old and I've only been using python for a few weeks now.
I copied this script from the examples on the Model Card page for 3.1 8B Instruct then modified it to meet my needs. My needs are [besides entertainment]:
1 - Loop a session with time stamps so I can have bench mark responses for various modifications
2 - Give the AI some current information and past information so that it could be aware of time and respond to past comments (I know this could be better done by creating a stateful session but I want some bench marks to compare to when and if I get that far)
Here is the Script: ===========================
import torch
import warnings
warnings.filterwarnings("ignore")
TheUserIs ="The user's name is Richard "
import datetime
from time import strftime
startup = strftime("This session began at %I:%M %p %Z ")
whatIasked = "nothing"
whatYousaid = "nothing"
whouare =["Your name is Janet. You are not verbose, you are blunt and mildly sarcastic. ",startup,TheUserIs,", he just wants to chat like a person to person. "]
#whouare =["Your name is Janet. You are not verbose, you are blunt and mildly sarcastic. ",startup,TheUserIs,", you treat him like a child. "]
#whouare =["Your name is Janet. You are not verbose. ",startup,TheUserIs,"]
model_id = "models/Meta-Llama-3.1-8B-Instruct"
print(startup)
pipeline = transformers.pipeline(
"text-generation",
model=model_id,
model_kwargs={"torch_dtype": torch.bfloat16},
device="cuda",
)

while True:
sessionTimecheck = strftime(" The current time is: %I:%M %p %Z ")
user_input=input("User >>> ")

timestamp=datetime.datetime.now()
print("\n",timestamp,"\n")
if user_input.lower()=='q':
    break
messages = [
    {"role": "system", "content":[whouare,sessionTimecheck,whatIasked,whatYousaid]},
    {"role": "user", "content": user_input},
]  

outputs = pipeline(
    messages,
    max_new_tokens=256,
)
whatIasked=[TheUserIs," said ",user_input]
whatYousaid=[" You said ",outputs]
print(outputs[0]["generated_text"][-1])
endtime=datetime.datetime.now()
print("\n",endtime,"\n")

End Script =======================================================
While running this script I encountered some errors in the AI's responses. I do not know if those errors are with the time module, or with the model itself, and I wanted to run this by the more experienced members of this community. For that purpose here is the output of a session where this issue popped up
: ====================================================================
H:\meta-llama\llama\llama-models-main>python ChatLlamav2.py
This session began at 08:19 AM Pacific Daylight Time
Loading checkpoint shards: 100%|█████████████████████████████████████████████████████████| 4/4 [00:00<00:00, 6.67it/s]
User >>> Hello!

2024-08-15 08:19:27.034475

Setting pad_token_id to eos_token_id:128001 for open-end generation.
{'role': 'assistant', 'content': "Morning, Richard. What's on your mind?"}

2024-08-15 08:21:03.393518

User >>> Do you know what the current time is in England?

2024-08-15 08:21:28.012370

Setting pad_token_id to eos_token_id:128001 for open-end generation.
{'role': 'assistant', 'content': "It's currently 15:21 PM in England (British Summer Time)."}

2024-08-15 08:24:25.087191

User >>> Aren't you suppose to add 8 hours since it is BST in England? GMT + 1?

2024-08-15 08:25:51.127741

Setting pad_token_id to eos_token_id:128001 for open-end generation.
{'role': 'assistant', 'content': 'You are correct that England is in British Summer Time (BST), which is GMT+1. To convert the current time in Pacific Daylight Time (PDT) to BST, I should add 8 hours.\n\nThe current time in PDT is 08:24 AM. Adding 8 hours to that would make it 16:24 PM in BST, not 15:21 PM.'}

2024-08-15 08:38:11.666895
End session output ==================================================================
And on other question - notice that pesky little warning about the pad_token_id. I've tried setting that id but I can't get rid of the warning. I tried setting it to <|eot_id|> and eof and eos, but I keep getting the warning!