When does Mathstral-7B-v0.1 Check External Sources?
As I get to know Mathstral-7B-v0.1, I've learned that it leans heavily on its data training. It claims to access external sources as needed, but when I put this to the test, I discover that rather than double-checking an external source to improve its accuracy, it will instead lean on its data training, even when it has been presented with the fact that it created an incorrect answer as a result of that training. The source I tested with was my own website for a podcast I do. Mathstral-7B-v0.1 reported that Tony Robbins was the host of the podcast. While flattered, I replied that the information was incorrect, that I was the host. I then asked it to check the website to find my name, but it avoided the request, saying that it was only trained on its training data. In other words, given a clear opportunity to seek out new information to improve its accuracy through a known, external source, it declined the opportunity. So it makes me wonder ... when would it ever seek out external data?