If you do, you must realize there can be consequences. Maybe it is worth it, maybe it is the worst move you can make.

If he has zero military he might be playing his turns, but he might also not care. Either of those two choices make for a dangerous target. If you 31-tap him he will likely make it his goal to ruin you.