Coding Systems of Transformers