Combining Distributed Vector Representations for Words (bibtex)
by Garten, Justin, Sagae, Kenji, Ustun, Volkan and Dehghani, Morteza
Abstract:
Recent interest in distributed vector representations for words has resulted in an increased diversity of approaches, each with strengths and weaknesses. We demonstrate how diverse vector representations may be inexpensively composed into hybrid representations, effectively leveraging strengths of individual components, as evidenced by substantial improvements on a standard word analogy task. We further compare these results over different sizes of training sets and find these advantages are more pronounced when training data is limited. Finally, we explore the relative impacts of the differences in the learning methods themselves and the size of the contexts they access.
Reference:
Combining Distributed Vector Representations for Words (Garten, Justin, Sagae, Kenji, Ustun, Volkan and Dehghani, Morteza), In Proceedings of NAACL-HLT 2015, Association for Computational Linguistics, 2015.
Bibtex Entry:
@inproceedings{garten_combining_2015,
	address = {Denver, Colorado},
	title = {Combining {Distributed} {Vector} {Representations} for {Words}},
	url = {http://ict.usc.edu/pubs/Combining%20Distributed%20Vector%20Representations%20for%20Words.pdf},
	abstract = {Recent interest in distributed vector representations for words has resulted in an increased diversity of approaches, each with strengths and weaknesses. We demonstrate how diverse vector representations may be inexpensively composed into hybrid representations, effectively leveraging strengths of individual components, as evidenced by substantial improvements on a standard word analogy task. We further compare these results over different sizes of training sets and find these advantages are more pronounced when training data is limited. Finally, we explore the relative impacts of the differences in the learning methods themselves and the size of the contexts they access.},
	booktitle = {Proceedings of {NAACL}-{HLT} 2015},
	publisher = {Association for Computational Linguistics},
	author = {Garten, Justin and Sagae, Kenji and Ustun, Volkan and Dehghani, Morteza},
	month = jun,
	year = {2015},
	keywords = {The Narrative Group, UARC},
	pages = {95--101}
}
Powered by bibtexbrowser