,

Method	Knowledge	Targeted	Unit	Task
	Black	✗	Character	MT
	Black	✗	Character	MT, morphology
	Black	✗	Character	Spelling correction
	Black	✓, ✗	Word	MT, NLI
	Black	✗	Character	Text classification, sentiment
	Black	✗	Sentence	Reading comprehension
	Black	✗	Syntax	Sentiment, entailment
	Black	✗	Word	Image captioning
	Black	✗	Word	NLI, sentiment
	Black	✗	Word	Text classification, sentiment
	Black	✗	Word	Reading comprehension, visual QA, sentiment
	Black	✗	Word	Dialogue
	White	✓	Pixels	Image captioning
	White	✓	Word	MT
	White	✓	Word	MT, summarization
	White	✗	Word	Reading comprehension, visual and table QA
	White	✗	Word	Sentiment
	White	✗	Word	Sentiment, gender detection
	White	✗	Word	Text classification, sentiment, grammatical error detection
	White	✓	Word/Character	Text classification
	White	✗	Word/Character	Text classification
	White	✗	Word/Character	Text classification
	Black	✗	Character	MT
	Black/White	✗	Sentence/Word	Reading comprehension