The problem with freediving during your surface interval is not accumulating more nitrogen, the problem is the rapid ascent. If you still have the residual nitrogen from the scuba, but you're not doing a slow ascent at the end of the freedive like you would on scuba, you could have problems.