Damon fell for the oldest prank in the Fox studio books - you don't wear Bermuda shorts to work no matter what anyone tells you