As the slurry continuous wave changes according to the measurement of drilling (MWD) date, the precision of error rate prediction is low and the process of transferring data will be affected by signals. Based on the BP neural networks extensive mapping ability and chaos optimization algorithms global convergent ability, we structure a kind of improved chaos optimization of BP neural network algorithm. This algorithm can avoid several problems, such as the convergent speed of BP neural network is slow and the BP neural network is easy to sink into local minimum. With the powerful ability of generalization and prediction, this kind of algorithm can also be used to predict the data transmission error rate in slurry continuous wave. Under the condition of small samples, we create a model of data transmission in slurry continuous wave, which is based on improved chaos optimization of BP neural network. Simulate experiment has tested this algorithms feasibility and effectiveness