knguyennguyen/mpnet_jacket4k_adjustedv3

SentenceTransformer based on sentence-transformers/all-mpnet-base-v2

This is a sentence-transformers model finetuned from sentence-transformers/all-mpnet-base-v2. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-mpnet-base-v2
• Maximum Sequence Length: 128 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 128, 'do_lower_case': False}) with Transformer model: MPNetModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("knguyennguyen/mpnet_jacket4k_adjustedv3")
# Run inference
sentences = [
    "kids' jacket featuring a soft exterior, cozy inner lining, and multiple pockets.",
    'Title: JORDAN CRAIG KIDS DENALI SHEARLING JACKET_MIDNIGHT SMOKE_91445B Descripion: Faux suede body Plush faux shearling lining throughout body and sleeves Shearling accented pockets Horn toggle front closure Vegan suede straps with buckle at neck Detachable faux fox fur hood with zipper Also available in RED, PINK, PURPLE, COGNAC, BLACK AND MIDNIGHT SMOKE. STYLE#: 91445B Zipper closure Faux suede body Plush faux shearling lining throughout body and sleeves Shearling accented pockets Horn toggle front closure Vegan suede straps with buckle at neck Detachable faux fox fur hood with zipper',
    "Title: Helly Hansen Women's Long Belfast Waterproof Windproof Breathable Raincoat Jacket with Hood, 597 Navy, Medium Descripion: 3/4 length Helly Tech Protection raincoat and hood keep the rain out, with comfort features inside. The mesh liner keeps you dry with added warmth and sporty detailing. Adjustable fit and zippered pockets add convenience. 100% Other Fibers Imported Zipper closure Machine Wash Helly Tech Protection Waterproof, windproof, and breathable 2 Ply fabric construction Fully seam sealed Durable Water Repellency treatment (DWR)",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Training Details

Training Dataset

Unnamed Dataset

• Size: 11,097 training samples
• Columns: anchor and positive
• Approximate statistics based on the first 1000 samples:

  	anchor	positive
  type	string	string
  details	min: 7 tokens mean: 13.56 tokens max: 30 tokens	min: 43 tokens mean: 120.72 tokens max: 128 tokens

• Samples:

  anchor	positive
  a winter jacket for outdoor activities and urban wear for women	Title: Obermeyer Women's Tuscany Ii Jacket Descripion: Stepping lightly on our planet has always been part of our mindset, this year we partnered with Repreve®, a branded performance fabric fiber made from recycled plastics, on our most popular winter jacket, The Tuscany II. The Tuscany II radiates tastefulness and beautiful styling. Whether in the city or on the trail, the Tuscany II is a winter coat that is timeless. Elevated sophistication with removable faux fur trim, extra-soft fleece lined collar, and adjustable hem. Special Inclusive Sizing available. 100% Polyester Imported Zipper closure Hand Wash Only 10K/10K Thermore Classic; 150gm body & sleeve; 40gm hood Ski Contour articulation; YKK zipper); removable hood; 2-way adjustable hood; Removable faux fur; fleece lined collar; zipper Handwarmer pockets); Zipper pass pocket(s) Stretch inner cuffs; fleece chin warmer; interior electronics pocket(s); cord routing Guide; interior goggle pocket; detachable, scratch-free goggle cloth; Snap-away water-resistant powder skirt; adjustable hem
  a shirt jacket for staying warm during cold nights	Title: Wrangler Authentics Men's Long Sleeve Sherpa Lined Shirt Jacket Descripion: Wrangler Authentics Men's Sherpa Lined Denim Shirt. Built to keep you warm and comfortable during those cold nights. This versatile shirt jacket is extremely functional and can be worn on many different occasions. Stay warm in this sherpa lined denim shirt all winter long. Shell: 55% Cotton, 45% Polyester; Lining: 100% Polyester Imported Button closure Machine Wash RELAXED FIT. Constructed with comfort in mind, this mid-weight flannel shirt will keep you comfortable in many climates. Wear alone or with additional layers in cooler temperatures. PLUSH SHERPA LINING. This unique flannel shirt allows you to take your Fall style into Winter with the added warmth of shearling lining. FUNCTIONAL STYLE. Guaranteed to keep you warm without compromising style, this shearling flannel is built for function and style. Wear it on the job or out to lunch, this shirt jacket can be worn for many occasions. ALL DAY COMFORT. Crafted with a 100% Cotton flannel shell and 100% Polyester soft tan sherpa lining with diamond black quilted padding in the sleeves, this shirt jacket is guaranteed to provide all day comfort. ADDED STORAGE. (2) Chest pockets to ensure that there is always room for your basic necessities - great for storing your wallet, sunglasses or any other quick-access items you may need.
  a blazer for formal occasions and events	Title: Men's Linen Blazer Jacket Casual Slim Fit Lightweight Two Buttons Blazer Sport Coat Descripion: Item: Men's Line Blazer Department :Mens Package include:1pc Linen Jacket You can choose high quality goods here,including men's wedding suits,business suits,tuxedo, men's dress suits,men's vest,suit for wedding prom and other clothes and clothing accessories. Nice choice for wedding party,nightclub,dinner,prom party,daily life,business meeting,homecoming and back to school,any fashion forward parties,any holiday,work and other Formal Occasions,Suits can also be given as birthday gifts to your family or friends. We are committed to offer you the most innovative and comfortable fabric product,and bring you the best service as we can. Note:1.The real color of the item may be slightly different from the pictures shown on website due to camera quality and monitor settings. Photos are taken in natural light with no flash. 2.Please allow slight deviation for the measurement data. 3.If there is no size that suits you,please send us your detail measurements as following: 1:neckline='' 2:shoulder='' 3:sleeve='' 4:armhole (bicep)='' 5:cuff='' 6:chest='' 7:belly='' 8:waist='' 9:hip='' 10:clothes length='' 11:pants length='' 12:thigh='' 13:height ='' 14:weight='' 50% Rayon, 50% Linen Imported Linen lining Button closure Hand Wash Only 【Premium Material】-- 50% Linen,50% Rayon;This Linen Balzer for men is made of high quality material which is comfortable,absorbent,good air permeability which can reduce skin irritation,and easier to wash,providing a comfortable wearing,experience and highlighting your body shape at the same time. 【About Size】-- More size information please refer to the size chart in the image,recommend 1-2 size up.If you have any questions about the linen suit,please feel free to contact us.We will provide the best solution for you within 24 hours. 【Occasion】-- This Linen Jacket is suitable for multiple occasions,such as Summer Beach,daily use,business meeting,fashion shows,parties,or grand holidays,etc.With our affordable price,we strongly suggest you,purchase multiple colors and it will be so easy to find your proper suit for the event! 【FINEST MATERIAL & CAREFUL CRAFTMANSHIP】-- Wangyue understands that upscale linen material and careful craftmanship are the two most important things to a linen blazer. That's why we are having the most experienced tailors to handmake these jackets with the finest fabric and material. From head to toe, you will find the blazer are exactly the same quality as our pictures. 【Can Give Gift】It is unique,comfortable,atmospheric and self cultivation.It is the best perfect gift for your father,son,boyfriend,classmate.If you take it out as a gift,it will brighten your face and at the same time,you will receive a lot of compliments.

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Evaluation Dataset

Unnamed Dataset

• Size: 300 evaluation samples
• Columns: anchor and positive
• Approximate statistics based on the first 300 samples:

  	anchor	positive
  type	string	string
  details	min: 8 tokens mean: 25.18 tokens max: 62 tokens	min: 52 tokens mean: 125.31 tokens max: 128 tokens

• Samples:

  anchor	positive
  a cardigan for school uniform or cosplay costume outfit for teen girls	Title: Teen Girls Cute Knitted V-Neck Sweater Anime Japanese Cosplay JK Uniform Cardigan Long Sleeve High School Cozy Jacket Coat Descripion: Size Chart(Inch): Small--Bust: 45.3 Shoulder:24.0 Shoulder:23.6 Medium--Bust:47.2 Shoulder:24.8 Shoulder:24.4 Large—Bust: 49.2 Shoulder:25.6 Shoulder: 25.2 X-Large—Bust: 51.2 Shoulder:26.4 Shoulder: 26.0 The size is Asian size, please refer to size details below before order Package includes: Cardigan sweater1 Design details: Japanese sailor jk uniform cardigan candy kawaii sweater with Long sleeve,v-neck Women knit sweater coat, The cardigan could as a cosplay costume outfit,also would be fine to wear costumes to school or as a regular outfit,relaxed fit,buttons closure and side pockets, perfect for casual, daily wear in spring, autumn, winter Machine washing is OK. cold water recommended. don’t bleach. hang to dry 进口 Button closure Machine Wash Package Included: 1Girl's sweater; other accessories that models wear in the pictures are not sold in this link. Feature: puff sleeve, v-neck, Japanese style, solid color, buttons closure, cozy fabric and loose fit teens coats, Loose Knitted Sweaters for Women Cute Sweater; Girls can wear it for school uniform, Japanese style loose fall sweaters v neck casual pullover sweaters for women soft warm juniors sweaters, Long Sleeve V-Neck Knitted Cardigan Sweater Anime Japanese School Girl Uniform Daily wear suit school uniforms, Fun as birthday or holiday gifts, Halloween party uniforms, Cosplay party uniforms. sailor suits, Christmas party and so on. Perfect to match with basic T-shirt, crop top, leggings, shorts, skirt, jeans, cosplay dress, knee high boots or lolita shoes for a cute look. Soft fabric, skin-friendly, keep you warm in spring and autumn
  a warm winter jacket for little girls aged 1-6 years	Title: ZHICHUANG Girls Novelty Stawberry Print Jacket for 1-6 Years,Little Girls' Winter Warm Thick Coat Bear Ears with Hooded Descripion: Toddler Baby Girls Boys Winter Cartoon Cow Strawberry Dinosaur Windproof Coat Hooded Warm Outerwear JacketFeatures:Feature：Main Color: The Picture ShowPattern Type:PrintIf your kid is , we recomend choosing a larger size, thanks.Material:PolyesterProduct Description:Main Color: The Picture ShowSizeRecommended AgeBustLength9012-24 Months67cm/26.38''37.5cm/14.76''1002-3 Years71cm/27.95''40cm/15.75''1103-4 Years75cm/29.53''42.5cm/16.73''1204-5 Years79cm/31.10''45cm/17.72''1305-6 Years83cm/32.68''47.5cm/18.70''Size:90Recommended Age:12-24 MonthsBust:67cm/26.38''Length:37.5cm/14.76''Size:100Recommended Age:2-3 YearsBust:71cm/27.95''Length:40cm/15.75''Size:110Recommended Age:3-4 YearsBust:75cm/29.53''Length:42.5cm/16.73''Size:120Recommended Age:4-5 YearsBust:79cm/31.10''Length:45cm/17.72''Size:130Recommended Age:5-6 YearsBust:83cm/32.68''Length:47.5cm/18.70''Size: 90 Recommended Age: 12-24 Months Bust: 67cm/26.38'' Length: 37.5cm/14.76'' Size: 100 Recommended Age: 2-3 Years Bust: 71cm/27.95'' Length: 40cm/15.75'' Size: 110 Recommended Age: 3-4 Years Bust: 75cm/29.53'' Length: 42.5cm/16.73'' Size: 120 Recommended Age: 4-5 Years Bust: 79cm/31.10'' Length: 45cm/17.72'' Size: 130 Recommended Age: 5-6 Years Bust: 83cm/32.68'' Length: 47.5cm/18.70'' 🎁✈ Fuzzy Fleece,Cotton Blend 🎉👏 Welcome to ZHICHUANG shop,we are a children's clothing shop,there are child winter jacket,coat,jumpsuis,pants set,boots shoes,support bulk purchase and express shipping,customer service is online 24 hours. 💯💖🌟 [Thanks Attention] - Please check our own size table to select right size(Not the Amazon Size Guide). We give detailed size information in the description on the bottom left page.Our size chart is based on standard data. If your child is a little bit taller or heavier, we recommend you choose the next size. If you can't choose the correct size or have any questions, please feel free to contact us. closure Hand Wash Only Material:Polyester Pattern Type:Solid Very stylish and cute design, carefully selected gentle and skin-friendly materials, and thickened warmth experience, so that your children will be protected from the cold in this Winter. Perfect for wedding , baptism, ceremony, dinner, kindergarten,school, photo shoot,formal wear, Christmas,birthday party, family gathering,casual daily wear, playwear or other occasions. Plus Elephant  Jumpsuit Coat
  a jacket for skiing and snowboarding activities for men	Title: Spyder Mens Hooded Midi Anorak Jacket Descripion: Spyder Signal GTX Anorak - 201040A functional yet stylish jacket that dominates around town and on the mountain, the Signal GTX Anorak is bringing back the Anorak design in a big way. GORE-TEX Stretch Polyester, 80 grams of black eco insulation and YKK zippers equip the Signal GTX Anorak with the tools necessary to conquer a hard day on the slopes. Large side body zips make the Signal GTX Anorak easy to get in and out of. A fully functional zippered front kangaroo pocket gives you all the storage you could possibly need. With all of these features, the Signal GTX Anorak is here to stay. Stretch Polyester Plain Weave 2L with GORE-TE Laminate and PFCecFree DWR PrimaLoft Black ECO Insulation (80g) YKK Zippers Fixed helmet compatible hood with adjustable opening Fully seam taped YKK reverse coil center front zipper Underarm ventilation system with side entry at wearer's right side Secure data card pocket Custom Chassis: Taffeta lining with strategic stretch panels and fixed powder skirt with snapback feature Hook and loop secure anorak pocket Zippered pass through kangaroo hand pockets Drawcord adjustable hem Polyester Zipper closure Hand Wash Only

• Loss: MultipleNegativesRankingLoss with these parameters:

  {
      "scale": 20.0,
      "similarity_fct": "cos_sim"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: epoch
• per_device_train_batch_size: 128
• learning_rate: 2e-05
• num_train_epochs: 10
• lr_scheduler_type: cosine
• warmup_ratio: 0.1
• load_best_model_at_end: True

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: epoch
• prediction_loss_only: True
• per_device_train_batch_size: 128
• per_device_eval_batch_size: 8
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• torch_empty_cache_steps: None
• learning_rate: 2e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1.0
• num_train_epochs: 10
• max_steps: -1
• lr_scheduler_type: cosine
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.1
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: True
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• eval_on_start: False
• use_liger_kernel: False
• eval_use_gather_object: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	loss
0.5747	50	1.6459	-
1.0	87	-	0.0897
1.1494	100	0.6779	-
1.7241	150	0.512	-
2.0	174	-	0.0765
2.2989	200	0.3965	-
2.8736	250	0.3655	-
3.0	261	-	0.0658
3.4483	300	0.3009	-
4.0	348	-	0.0658
4.0230	350	0.2838	-
4.5977	400	0.2394	-
5.0	435	-	0.0689
5.1724	450	0.2279	-
5.7471	500	0.2125	-
6.0	522	-	0.0680
6.3218	550	0.1913	-
6.8966	600	0.1899	-
7.0	609	-	0.063
7.4713	650	0.1793	-
8.0	696	-	0.0631
8.0460	700	0.1676	-
8.6207	750	0.1643	-
9.0	783	-	0.0638
9.1954	800	0.1772	-
9.7701	850	0.1665	-
10.0	870	-	0.0636

• The bold row denotes the saved checkpoint.

Framework Versions

• Python: 3.11.11
• Sentence Transformers: 3.1.1
• Transformers: 4.45.2
• PyTorch: 2.5.1+cu121
• Accelerate: 1.2.1
• Datasets: 3.2.0
• Tokenizers: 0.20.3

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply},
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}