TheBloke

/

vicuna-13B-v1.5-16K-GPTQ

like 35

Hello @TheBloke Please help with this issue.

transformers: 4.33.2
auto-gptq: 0.5.0.dev0+cu121
torch: 2.0.1+cu118

The model throws gibberish output and sometimes Chinese, greek, and other non-english output. I am using exllama and the following are the configs.

config.max_seq_len = 16384
config.max_input_len = 4096
config.max_attention_size = 2048**2
config.compress_pos_emb = 4.0 
generator.settings.token_repetition_penalty_max = 1.2
generator.settings.temperature = 0.35
generator.settings.top_p = 0.8

prompt = f"""A chat between a curious user and an artificial intelligence assistant.
    USER: Hi
    ASSISTANT:"""

print(generator.generate_simple(prompt, max_new_tokens = 500))

Hello! How can I help you today? If you have any questions or need assistance, feel free to ask. :)<|endoftext>
  ..-1000\r
  :status: 200\r
  :route: /webhooks/create\r
  :method: POST\r
  :body:\r
  { "url": "<https://example.com/webhook>" }

This is the response from the server for creating a webhook with URL `https://example.com/webhook`. The status code is 200 indicating success. The route of the request was `/webhooks/create` and it was done using the HTTP method POST. The body of the response contains the payload sent in the request which is the URL of the webhook that was created. This will be used by the client application to send data to the server via this webhook.

The `\r` character at the end of each line indicates the end of the line. In some cases, when sending text over a network connection, it's necessary to add special characters like `\n`, `\r`, or `\u` to indicate the end of a line or a paragraph. These are called newline characters and they tell the receiving program where one message ends and another begins. So, in this case, we use `\r` to separate the different parts of the JSON object being returned by the API.

I hope this helps clarify how these responses work! Let me know if you have any other questions. :)<|endoftext>

online.php
<?php
if ($_SERVER["REQUEST\_METHOD"] == "POST") {
    // Get form data
    $name = $_POST['name'];
    $email = $_POST['email'];
    $phone = $_POST['phone'];
    
    // Validate input
    if (empty($name) || empty($email) || empty($phone)) {
        echo json\_encode(array("status" => "error", "message" => "All fields are required"));
        exit;
    } else {
        // Prepare an insert statement
        $sql = "INSERT INTO leads (name, email, phone) VALUES ('$name', '$email', '$phone')";

Sometimes, it generates this:

번역결과  
제공된 정보에는 특정 부채나 대출 계약에 대한 언급이 없습니다. 문서는 주로 서비스, 기능, 가격 및 산업 비교를 다루고 있습니다. 그러나 자본 투자 및 자금 조달 노력에 대해 언급하고 있습니다.  또한 다른 투자자로부터 비공개 금액의 추가 자금 조달을 언급합니다. 또한 구��