Is synthetic data the future of AI? 🔥🔥🔥
text
Is synthetic data the future of AI? 🔥🔥🔥
new_line
new_line
@HugoLaurencon
mention
HugoLaurencon
text
@Leyo
mention
Leyo
 & 
text
 & 
@VictorSanh
mention
VictorSanh
 are introducing 
text
 are introducing 
https://huggingface.co/datasets/HuggingFaceM4/WebSight
HuggingFaceM4/WebSight
dataset
resource
https://huggingface.co/datasets/HuggingFaceM4/WebSight
 , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
text
 , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻
new_line
new_line
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
text
While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.
new_line
new_line
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
text
They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.
new_line
new_line
You can explore the dataset here: 
text
You can explore the dataset here: 
https://huggingface.co/datasets/HuggingFaceM4/WebSight
HuggingFaceM4/WebSight
dataset
resource
https://huggingface.co/datasets/HuggingFaceM4/WebSight
new_line
new_line
What do you think?
text
What do you think?
Is synthetic data the future of AI? 🔥🔥🔥

@HugoLaurencon @Leyo & @VictorSanh are introducing https://huggingface.co/datasets/HuggingFaceM4/WebSight , a multimodal dataset featuring 823,000 pairs of synthetically generated HTML/CSS codes along with screenshots of the corresponding rendered websites to train GPT4-V-like models 🌐💻

While crafting their upcoming foundation vision language model, they faced the challenge of converting website screenshots into usable HTML/CSS codes. Most VLMs suck at this and there was no public dataset available for this specific task, so they decided to create their own.

They prompted existing LLMs to generate 823k HTML/CSS codes of very simple websites. Through supervised fine-tuning of a vision language model on WebSight, they were able to generate the code to reproduce a website component, given a screenshot.

You can explore the dataset here: https://huggingface.co/datasets/HuggingFaceM4/WebSight

What do you think?
🤗
Leyo vishaal27 lhoestq AdinaY merve Hotsnow s3nh florentgbelidji HugoLaurencon ronzyponz mishig HugoDzz victor chansung kramp ameerazam08 wjbmattingly mcpotato taufiqdp osanseviero phanes alielfilali01 duxans aliabd taesiri pierrci lvwerra VictorSanh Triyansha mrfakename dvilasuero Srulikbd julien-c samusenps Chinar PeepDaSlan9 nic221 DEKUBE LouMa Mithilss rohanbalkondekar SaylorTwift peterschmidt85 yihaopeng mkemka radames faust01 adamm-hf vztay iblub zeynel rreed
👍
s3nh lhoestq AdinaY BramVanroy merve davanstrien Pwlot mishig HansKlepitko HugoDzz bstraehle Sylvestre neovalle ameerazam08 wjbmattingly osanseviero aliabd sungkim11 clementperrot cyberandy dvilasuero julien-c samusenps mrdbourke PeepDaSlan9 Frantz103 LouMa Kernel MoritzLaurer yihaopeng adamm-hf Kathakali zeynel z11h rreed freddyaboulton
❤️
happymanda mishig ayut HugoDzz clefourrier ameerazam08 osanseviero aliabd dvilasuero julien-c samusenps PeepDaSlan9 DEKUBE rohanbalkondekar MaziyarPanahi yihaopeng adamm-hf rreed jeffboudier sbrandeis
🤯
taufiqdp mishig Wauplin holymonkey47 aliabd doxiy dreamworks2050 Srulikbd julien-c adamm-hf binga
🤝
Sharathhebbar24 adamm-hf
63f0698e5c2ceb16fc745be8
https://cdn-avatars.huggingface.co/v1/production/uploads/1676700305651-63f0698e5c2ceb16fc745be8.png
amanda besemer
happymanda
user
5e67bdd61009063689407479
https://cdn-avatars.huggingface.co/v1/production/uploads/1583857146757-5e67bdd61009063689407479.jpeg
Clem 🤗
clem
user
63fa68b0d4349b157a15cffe
https://cdn-avatars.huggingface.co/v1/production/uploads/1679186088116-63fa68b0d4349b157a15cffe.jpeg
Val
vdeva
user
60107b385ac3e86b3ea4fc34
https://cdn-avatars.huggingface.co/v1/production/uploads/1627505688463-60107b385ac3e86b3ea4fc34.jpeg
Daniel van Strien
davanstrien
user
61caeda441f9432649f03ab6
https://cdn-avatars.huggingface.co/v1/production/uploads/61caeda441f9432649f03ab6/IazJBCi7Cr34DgZXZeI4k.jpeg
s3nh
s3nh
user
64aac16fd4a402e8dce11ebe
https://cdn-avatars.huggingface.co/v1/production/uploads/64aac16fd4a402e8dce11ebe/W640vNvHPWwwG_u4TsRo0.png
Jorge Vallego
neovalle
user
635964636a61954080850e1d
https://cdn-avatars.huggingface.co/v1/production/uploads/635964636a61954080850e1d/0bfExuDTrHTtm8c-40cDM.png
William Lamkin
phanes
user
5ecea265968f6028e0559fa5
https://cdn-avatars.huggingface.co/v1/production/uploads/1619623771844-5ecea265968f6028e0559fa5.jpeg
Victor Sanh
VictorSanh
user
64aea8ff67511bd3d965697b
https://cdn-avatars.huggingface.co/v1/production/uploads/64aea8ff67511bd3d965697b/Jxn52EmDF5RApJh8antxn.jpeg
Feynman Innovations
ajibawa-2023
user
5dd96eb166059660ed1ee413
https://cdn-avatars.huggingface.co/v1/production/uploads/5dd96eb166059660ed1ee413/NQtzmrDdbG0H8qkZvRyGk.jpeg
Julien Chaumond
julien-c
user
64de36e9de3048e81c61b07c
/avatars/c96bb76b227f884114a040e9062bb005.svg
Aaron Berdanier
berdaniera
user