introduction
This is an undergraduate course project in computer security.
The task is to fine tune the large model to achieve malicious network flow data detection.
base model
bert-base-uncased
dataset:
19kmunz/iot-23-preprocessed-minimumcolumns
example prompt:
8081 tcp S0 2 80 0
37215 tcp S0 2 80 0
52869 tcp S0 2 80 0
8080 tcp S0 2 80 0
80 tcp S0 2 80 0
The above are "malicious", which is "label_1".
67 udp S0 11 3608 0
0 icmp OTH 9 844 0
136 icmp OTH 3 216 0
0 icmp OTH 8 648 0
134 icmp OTH 2 96 0
The above are "Benign", which is "label_0".
accuracy
Training Loss Valid. Loss Valid. Accur.
epoch
1 0.288545 0.190351 0.929988
2 0.147658 0.154426 0.943510
3 0.108059 0.173112 0.943510
4 0.092468 0.161035 0.947416
MCC score： 0.816
The "Total MCC" refers to the Matthews Correlation Coefficient (MCC), typically used to assess the quality of predictions in binary classification problems.
The MCC value ranges from -1 to 1, where 1 signifies perfect predictions, 0 indicates predictions similar to random chance, and -1 denotes completely opposite predictions.
A model with an MCC value of 0.816 can be considered quite good. This value being close to 1 implies that the model has a high predictive capability and can classify samples with considerable accuracy. A higher MCC value closer to 1 indicates stronger predictive ability in the model.
In summary, an MCC value of 0.816 indicates that the model demonstrates a high level of accuracy and predictive capability in binary classification tasks.
- Downloads last month
- 7