Conditional Language Generation with BERT
- 0 Collaborators
Using BERT for doing the task of Conditional Natural Langauge Generation by fine-tuning pre-trained BERT on custom dataset. ...learn more
Project status: Published/In Market
Groups
DeepLearning,
Student Developers for AI
Intel Technologies
DevCloud
Overview / Usage
This is an attempt to see if pre-trained can be conditioned to generation language on some particular topic.
Methodology / Approach
Fine-tuning BERT LM on custom Text. Use the fine-tuned model to generate language with top-k sampling in random hop fashion.
Technologies Used
Pytorch
BERT
Language Model
Language Decoding