I’m trying to use BERT for custom token classification, I have annotated data for this task using doccano, the exported dataset in jsonl format looks like this: {"text": "EU rejects German call to boycott British lamb.", "label": [ [0, 2, "ORG"], [11, 17, "MIS"] ]} {"text": "Peter Blackburn", "labe…

I found the solution, using this doccano/doccano-transformer from the docanno team. There is a catch though, it has an annoying bug solved by this , and since there is next to no documentation, we can use this to write the file. :ok_hand:

Doccano dataset for named entity recognition task using BERT

Beginners

nielsr May 8, 2024, 11:51am 2

Hi,

That’s already great! Citing myself here NER model fine tuning with labeled spans - #3 by nielsr

Topic		Replies	Views
Create custom tags for fine-tuning Bert for NER task 🤗Datasets	0	918	January 22, 2024
Tutorial: Fine-tuning with custom datasets – sentiment, NER, and question answering 🤗Transformers	19	13037	February 12, 2024
How can I do NER by bert? Beginners	3	133	April 21, 2024
How to fine tune bert on entity recognition? Beginners	23	7492	November 21, 2022
How to deal with differences between CoNLL 2003 dataset tokenisation and BER tokeniser when fine tuning NER model? Intermediate	6	2801	November 23, 2021

Doccano dataset for named entity recognition task using BERT

Related topics