Well, it's not really a matter of what is right or wrong.
Jesus made the Sabbath so He could spend time with us, like in Mark 2:27:
And He said unto them, The Sabbath was made for man, and not man for the Sabbath.(Mark 2:27)
It's really between you and God...
Just think, would you be comfortable with Jesus sitting next to you doing that?