Over the last couple of days, I have retooled MOLIERE into a system that anyone¹ can deploy it and run their own queries. The code is over at the [default repo][moliere_repo]² and should be pretty straightforward, the code even downloads raw data itself! Just run build_network.py and point it at a big parallel file systen — in a few hours you’ll have your very own knowledge network!

This project was a pretty crazy conglomeration of everything I’ve been up to. To start, this implements a new stopword cleaning method (inspired by [this list from Swanson][stopword_list]). We also use a new phrase mining tool, [AutoPhrase][autophrase_git_link], to replace ToPMine.

Overall, these improvements are qualitatively more interpretable than the previous method. And, the changes in the codebase make it easier to add or remove new data sources. For example, this network construction script can choose to include [UMLS][UMLS_link] based on whether the use has it installed. I’m planning on extending this to incorporate [SemMedDB][semmeddb_link] and hopefully some gene-specific data.

Also, in the short-term, I’m hoping to redo my validation experiments, as presented in [this paper][validation_paper_link], to see how these changes may have improved our overall performance.