I would say as long as you're maintaining weight, don't worry about it too much. If your job is really that physical you could easily need 4000+ calories per day and not much can be reduce your intake.
Case in point: Back in college(aka The Day) a nutrition class project in which we kept as complete of a food diary as we could manage happened to coincide with the start of rugby season. I averaged just over 3700 calories per day consumed, lost 4 lbs over those two weeks and rugby practice was just under 3 hours per day.
If you're concerned about a deficiency; keep a food diary. You could use one online like
Nutrition facts, calories in food, labels, nutritional information and analysis – NutritionData.com , which i think is still free and will do the calculations for you. It's just up to you to accurately record what you eat.