Volume Transmittance Estimation Based on DeepRL

Experimental project to use deep reinforcement learning in rendering problem.

In the project of Deep Reinforcement Learning by Prof. Lu Zongqing, I did some experimental trials on using RL to do volumetric transmittance. At that time, I read lots of papers regarding volumetric transmittance estimation (which is thoroughly summarized in a blog) and thought it was a viable topic. Roughly speaking, I hoped to sample at better positions during estimation; the positions plus other status were seen as history, and the RL model predicted the next sample position as its action. Predictably,its performance would be quite bad since traditional statistical process could draw samples much quicklier than model prediction, and the computation cost would be much lower too. However, my objective was to validiate that whether RL could really choose better positions under my history settings, so that wasn’t a real problem for me.

BTW, I did lots of interesting tasks in this course, and it’s worthwhile to list them here later! Please wait for my future update.