As already reported here in a joint research phase with a leading northern German company in the field of technical documentation LangTec has been working on a AI-based authoring support system for text completion in the text domain of technical documentation.

Now we can report extremely convincing results for this proof of concept. Among other results we were able to improve prediction accuracy on the next word by 45 (top 10 predictions) to 62 (top 1) percentage points due to finetuning the base language model on client data. Additionally, this project allowed LangTec to use and extend its expertise in the field of neural language models, especially with respect to deeper interventions in the standard software architecture of the language model.