Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".
text
Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".
new_line
new_line
https://huggingface.co/blog/diwank/cryptgpt-part1
https://huggingface.co/blog/diwank/cryptgpt-part1
link
new_line
new_line
tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.
text
tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.
new_line
new_line
links:
text
links:
new_line
https://github.com/creatorrr/cryptgpt
https://github.com/creatorrr/cryptgpt
link
new_line
https://huggingface.co/diwank/cryptgpt
diwank/cryptgpt
model
resource
https://huggingface.co/diwank/cryptgpt
new_line
https://huggingface.co/diwank/cryptgpt-large
diwank/cryptgpt-large
model
resource
https://huggingface.co/diwank/cryptgpt-large
Just published "CryptGPT: A Simple Approach to Privacy-Preserving Language Models Using the Vigenere Cipher".

https://huggingface.co/blog/diwank/cryptgpt-part1

tl;dr - we pretrained a gpt-2 tokenizer and model from scratch on a dataset encrypted with Vigenere cipher and it performs as well as regular gpt-2. Except in order to use it, you need to know the encryption key.

links:
https://github.com/creatorrr/cryptgpt
https://huggingface.co/diwank/cryptgpt
https://huggingface.co/diwank/cryptgpt-large
👍
algorithm
🤗
pduf
6093a02dc4a92d63a91c5236
https://cdn-avatars.huggingface.co/v1/production/uploads/6093a02dc4a92d63a91c5236/yUte6V0FU0BvVFAbON-9n.jpeg
Diwank Tomer
diwank
user