Grimulkan's picture

29 1 1

Grimulkan

grimulkan

·

grimulkan

AI & ML interests

None yet

Organizations

None yet

grimulkan's activity

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-2.4bpw_h6_exl2 4 months ago

10k you say...

#1 opened 4 months ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 9 months ago

max_position_embedding

#5 opened 9 months ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-6bpw-h8-exl2 11 months ago

EXL quantization at 4.0bpw?

#1 opened 11 months ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 12 months ago

Further fine-tuning?

#4 opened 12 months ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 about 1 year ago

Comparison with 0.1

#3 opened about 1 year ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-fp16 about 1 year ago

Benchmarks!

#2 opened about 1 year ago by

New activity in grimulkan/llama2_70b_longlora_fp16_32k_ROPE8 about 1 year ago

Benchs

#1 opened about 1 year ago by

New activity in Nexesenex/MIstral-QUantized-70b_Miqu-1-70b-iMat.GGUF about 1 year ago

Arch speculations

#3 opened about 1 year ago by

New activity in grimulkan/Goliath-longLORA-120b-rope8-32k-fp16 about 1 year ago

More quants

#2 opened about 1 year ago by

Observations+benchmarks

#1 opened about 1 year ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 about 1 year ago

Merging advice?

#2 opened about 1 year ago by

sophosympatheia

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16 about 1 year ago

2 bits GGUF SOTA quants?

#2 opened about 1 year ago by

New activity in grimulkan/lzlv-longLORA-70b-rope8-32k-fp16 about 1 year ago

Quantization calibration dataset

#1 opened about 1 year ago by

New activity in grimulkan/aurelian-v0.5-70b-rope8-32K-fp16 about 1 year ago

Devolution into semi-nonsensical long words

#1 opened about 1 year ago by

New activity in Squish42/bluemoon-fandom-1-1-rp-cleaned about 1 year ago

Feedback and collaboration.

#1 opened over 1 year ago by

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-fp16 about 1 year ago

You made gold!

#1 opened about 1 year ago by

New activity in grimulkan/aurelian-alpha0.1-70b-rope8-32K-6bpw_h8_exl2 about 1 year ago

Repetition issue

#1 opened about 1 year ago by

lazyDataScientist

New activity in Noeda/aurelian-alpha0.1-70b-rope8-32K-GGUF about 1 year ago

GGUF parameters suggestion

#1 opened about 1 year ago by

lazyDataScientist

New activity in jondurbin/airoboros-l2-70b-3.1.2 about 1 year ago

Space after [/INST]

#2 opened over 1 year ago by

Space after [/INST]

#2 opened over 1 year ago by