Flowfile is currently penalized in Apache NiFI between ExtractText and PutSQL processors in NiFi
Alok Kumar
Posted on August 19, 2024
I have a requirement to read say name of users from a file(all in new lines) and insert to Database(oracle). I am using GetFile->SplitText->ExtractText->PutSql in NiFi. All works fine for less records(around 10 records). But when I try it for 50 or 100 plus records, the connection between ExtractText and PutSql, I am getting "A flowfile is currently penalized and data can not be processed at this time". Also all flowfiles remain in queue.
Note in PutSQL I am using simple sql (insert into users_table(user_name) values ('user123'); It works properly for 10, 20 records but when I provide 100+ records then it gets stuck.
💖 💪 🙅 🚩
Alok Kumar
Posted on August 19, 2024
Join Our Newsletter. No Spam, Only the good stuff.
Sign up to receive the latest update from our blog.