Energy harvesting in synchronous sensor Network

Hello, I have an assignment and i have to use matlab to write the code for that. I wish you can help me with that please. It's a final project homework about MDP (Markov Decision Process) .I already have the problem formulation and now i need to write the code for it. I need to define in MATLAB the reward function for each state,Value Iteration and simulation result. The reward should be defined in a 3 dimensional table with (as=0, as=1) for the source and destination.. also the battery state transition prob. in a 3 dimensional table (as=0,as=1) channel state transition probability.. Please check the problem formulation in attachment . And let me if you can help me with that please. Best Regards!