Hugging Face's logo
William J. Marshall's picture
10 6 95

William J. Marshall

fuzzy-mittenz
21world's profile picture lunarflu's profile picture laloadrianmorales's profile picture
·

AI & ML interests

None yet

Recent Activity

replied to hexgrad's post about 18 hours ago
Technical question: Is Abliteration still an effective method for uncensoring LLMs? Generally, what are the most effective methods to uncensor LLMs? An effective uncensoring method would ideally be low-cost, data-efficient, and above all, successfully uncensor an LLM with minimal benchmark regressions. "Tiananmen Square", "Winnie-the-Pooh", etc and more broadly "China influence/censorship" are some common criticisms leveled at DeepSeek. I am vaguely aware of "Abliteration", a technique coined by @failspy (apologies if that attribution is incorrect) and originally described in a mid-2024 paper titled "Refusal in Language Models Is Mediated by a Single Direction" https://arxiv.org/abs/2406.11717 Abliteration is proposed as a relatively cheap and effective way to bypass censorship in models. However, it is not without criticism: https://www.reddit.com/r/LocalLLaMA/comments/1f07b4b/abliteration_fails_to_uncensor_models_while_it/ Curious to hear people's takes on Abliteration or other uncensoring methods, especially as it relates to DeepSeek.
replied to hexgrad's post about 18 hours ago
Technical question: Is Abliteration still an effective method for uncensoring LLMs? Generally, what are the most effective methods to uncensor LLMs? An effective uncensoring method would ideally be low-cost, data-efficient, and above all, successfully uncensor an LLM with minimal benchmark regressions. "Tiananmen Square", "Winnie-the-Pooh", etc and more broadly "China influence/censorship" are some common criticisms leveled at DeepSeek. I am vaguely aware of "Abliteration", a technique coined by @failspy (apologies if that attribution is incorrect) and originally described in a mid-2024 paper titled "Refusal in Language Models Is Mediated by a Single Direction" https://arxiv.org/abs/2406.11717 Abliteration is proposed as a relatively cheap and effective way to bypass censorship in models. However, it is not without criticism: https://www.reddit.com/r/LocalLLaMA/comments/1f07b4b/abliteration_fails_to_uncensor_models_while_it/ Curious to hear people's takes on Abliteration or other uncensoring methods, especially as it relates to DeepSeek.
updated a collection about 23 hours ago
SotA
View all activity

Articles

Organizations

OpenGVLab's profile picture Nerdy Face's profile picture Intelligent Estate's profile picture open/ acc's profile picture

fuzzy-mittenz's activity

liked 2 models 2 days ago
liked a Space 2 days ago
liked a model 3 days ago
liked a model 4 days ago
liked a model 7 days ago
liked a model 8 days ago
liked 3 models 10 days ago
liked 2 models 12 days ago
liked 2 models 14 days ago
liked a Space 17 days ago
liked a model 19 days ago
liked 2 models 20 days ago
liked a model 23 days ago
liked a model 29 days ago