Context may be all you need