Data preprocessing for extractive QA

ryansmoak

RyanSmoak

Posted on April 6, 2024

Data preprocessing for extractive QA

I want to start a new project to do extractive QA based on a certain text corpus that is hundred of pages long but I don't know how to preprocess the data. I was planning on training BERT on the text corpus that looks like this:
Image description
How can I turn this into something that BERT can learn from? If you need me to clarify on anything, just ask. All help is appreciated.

💖 💪 🙅 🚩
ryansmoak
RyanSmoak

Posted on April 6, 2024

Join Our Newsletter. No Spam, Only the good stuff.

Sign up to receive the latest update from our blog.

Related

Data preprocessing for extractive QA
beginners Data preprocessing for extractive QA

April 6, 2024