CNC precision machining tolerance tiers from ±0.005 to ±0.0001 in., real cost impact per tier, and how to specify tolerances without overpaying. Engineer-written guide.
Miles
Published Date: 2026/4/13
CNC precision machining achieves tolerances from ±0.005 in. (standard) down to ±0.0001 in. (ultra-precision). Each tier tighter roughly doubles machining cost. Most parts only need 2-3 critical dimensions held tight; blanket-tight tolerances waste 30-50% of your budget. Specify precision where function demands it, and leave non-critical features at standard tolerance.
Engineers overpay for CNC precision machining more often than they underpay. Not because the work is overpriced, but because the drawing calls for tolerances that the part doesn't actually need.
Here's what happens: a designer specifies ±0.001 in. across an entire drawing because "tighter is better." The shop quotes it. The price comes back 40% higher than expected. The designer is shocked. But the shop isn't wrong. Holding ±0.001 in. on every feature means slower feeds, more inspection passes, temperature-controlled fixturing, and CMM verification on dimensions that have zero functional impact.
CNC precision machining isn't about making everything as tight as possible. It's about putting precision where it matters and leaving everything else at standard tolerance. This guide breaks down the real tolerance tiers, what each one costs, which features actually need tight callouts, and how to communicate that to your CNC machining supplier without overspending.
CNC precision machining is a subtractive manufacturing process where computer-controlled cutting tools remove material from a workpiece to achieve dimensions within very tight tolerance bands, typically ±0.001 in. (±0.025 mm) or better. The "precision" distinction separates it from standard CNC machining, which works to general tolerances of ±0.005 in. (±0.127 mm) per ISO 2768 medium.
The difference isn't just a smaller number on paper. Precision machining requires specific conditions: rigid machine tools with thermal compensation, high-quality tooling (often carbide or ceramic inserts with specific nose radii), controlled ambient temperature (±2°F in the machining zone), and inspection equipment capable of measuring to 10x the tolerance being held. If you're calling out ±0.0005 in., your supplier needs to measure to ±0.00005 in., and that means CMM or optical comparator, not calipers.
That inspection capability matters as much as the machining capability. A shop can cut a feature to ±0.0005 in. all day, but if they can't prove it on the inspection report, it doesn't count.
There are four practical tolerance tiers in CNC machining. Each one has different cost implications, different equipment requirements, and different inspection protocols.
Tier 1: Standard (±0.005 in. / ±0.127 mm)
This is the default for most CNC machine shops. If your drawing has no tolerance callout on a dimension, the shop applies ISO 2768 medium (or the ASME equivalent). A standard 3-axis CNC milling machine in good condition hits this without special effort. Inspection is typically calipers or a height gauge. Cost impact: baseline.
Tier 2: Close (±0.001 in. / ±0.025 mm)
This is where "precision" begins. The shop needs a well-maintained machine (minimal backlash, thermal stability), sharp tooling, and a CMM or surface plate with indicator for verification. Expect the per-feature machining cost to be 1.5-2x the standard tier. This is the most common precision callout for functional features like bearing bores, dowel pin holes, and mating surfaces.
Tier 3: Precision (±0.0005 in. / ±0.013 mm)
Now you're in territory where ambient temperature matters. A 10°F temperature swing in the shop can cause a 12-inch aluminum part to expand or contract by 0.0007 in. (aluminum's CTE is roughly 13 µin./in./°F). Shops holding this tier either run climate-controlled rooms or compensate mathematically. Inspection is CMM-only. Cost: 2-3x standard. Common for aerospace bearing fits, hydraulic valve spools, and medical implant interfaces.
Tier 4: Ultra-Precision (±0.0001-0.0002 in. / ±0.003-0.005 mm)
Rare. Reserved for optical components, semiconductor fixtures, and specific aerospace actuator bores. Requires jig grinding, lapping, or honing after CNC turning or milling. Inspection is often optical flat comparison or air gauging, not just CMM. Cost: 5-10x standard. If your drawing has these callouts on more than 2-3 features, ask yourself if every one of them is truly necessary.
The mistake that costs the most money? Applying Tier 2 or Tier 3 tolerances uniformly across a drawing when only 3-5 features out of 30 actually need them.
The relationship between tolerance and cost is not linear. It's exponential.
Going from ±0.005 in. to ±0.001 in. might add 50-80% to the machining time on that feature. Going from ±0.001 in. to ±0.0005 in. can double it again. And jumping to ±0.0001 in. can multiply the original cost by 5-10x, because you've likely left the domain of standard CNC cutting and entered grinding or lapping territory.
Here's why. At standard tolerance, the machinist runs aggressive feeds and speeds. Chip load is high, material removal rate is fast, and one finishing pass gets the job done. At ±0.001 in., feed rate drops, a spring pass (a final pass at zero depth of cut to let deflection settle) gets added, and the operator measures before unclamping. At ±0.0005 in., the operator may rough the feature, semi-finish, then take two light finishing passes with pauses between them to let cutting heat dissipate. Temperature-induced growth on a steel shaft (CTE ~6.5 µin./in./°F) can eat half the tolerance budget if the part is warm when measured.
There's also the inspection cost multiplier. Standard tolerance gets a spot check with calipers. Precision tolerance gets CMM programming, multiple measurement points per feature, and a formal inspection report. On a part with 15 tight-tolerance features, CMM inspection alone can take 30-60 minutes, which at $100-150/hr inspection rates adds $50-150 per part to the total.
The practical rule: apply tight tolerance only to features where function demands it. A clearance hole for an M6 bolt does not need ±0.001 in. A bore that accepts a press-fit bearing does.
Not all materials behave the same under precision machining conditions. Hardness, thermal expansion, and internal stress all affect how well a material holds its machined dimension.
Best for precision work:
Hardened tool steels (4140 pre-hard, A2, D2) hold dimension exceptionally well because they resist deflection under cutting forces. Their thermal expansion is moderate (CTE ~6-7 µin./in./°F), and they don't spring back after machining. The trade-off: tool wear is higher, and you need carbide or CBN inserts.
Stainless steel grades 303 and 416 (free-machining variants) hold precision tolerance well. Avoid 304 and 316L for ultra-tight work unless you have experience with their work-hardening behavior. A dull tool on 316L creates a hardened surface layer that makes the next pass cut inconsistently.
Aluminum alloys (6061-T6, 7075-T6) machine beautifully to tight tolerances, but their high CTE (13 µin./in./°F) means thermal management matters. A part machined at 85°F shop temperature and inspected at 68°F will measure differently. On a 10-inch dimension, that 17°F difference causes 0.0022 in. of contraction. That's larger than a Tier 3 tolerance band.
Challenging for precision:
Plastics are difficult to hold below ±0.002 in. reliably. PEEK is the best of the engineering plastics for precision work, but even PEEK has a CTE roughly 3x that of steel. Nylon, acetal (Delrin), and polycarbonate absorb moisture and swell, which means a part machined to spec today may be out of spec next week if stored in a humid environment.
Thin-walled parts in any material are difficult to hold tight. A wall thickness below 0.040 in. will deflect under cutting forces regardless of material. If your design requires precision on thin features, discuss fixturing strategy with your supplier before committing to the tolerance.
The measurement tool must be at least 10x more precise than the tolerance being verified. This is the 10:1 gauge resolution rule, and it's a requirement in most quality systems (ISO 9001, AS9100D).
Calipers (digital, ±0.0005 in. resolution): Suitable for standard tolerance (±0.005 in.) verification only. Not appropriate for precision work because the resolution barely meets the 10:1 rule, and operator technique introduces additional error.
Micrometers (±0.0001 in. resolution): Good for Tier 2 and some Tier 3 external dimensions. Temperature-sensitive; the inspector's body heat through the frame can affect readings on large micrometers.
CMM (Coordinate Measuring Machine, ±0.00005 in. or better): The standard for Tier 3 and Tier 4 work. Programmable, repeatable, and generates documented inspection reports. CMM inspection per FlagShip's quality process verifies GD&T callouts including true position, profile, and concentricity that calipers and micrometers simply cannot measure.
Optical comparators: Project a magnified silhouette of the part onto a screen with an overlay of the nominal profile. Useful for verifying complex profiles, radii, and edge breaks that are difficult to probe with a CMM stylus.
Air gauging (±0.00001 in. resolution): For ultra-precision bore diameters. Compressed air flows through a calibrated nozzle inside the bore; the back-pressure changes with diameter. Non-contact, fast, and extremely repeatable for production measurement.
The right question to ask your supplier: "How do you inspect the precision features on this part, and can I get the inspection report with the shipment?" If the answer is vague, the precision claim may be too.
Follow these five rules and your precision machining quotes will be 20-40% lower without sacrificing part function.
1. Use a general tolerance block. Put "UNLESS OTHERWISE SPECIFIED: ±0.005 in." in the title block. This covers every dimension that doesn't need special attention.
2. Call out tight tolerances only on functional features. Bearing bores, mating surfaces, press-fit diameters, sealing faces, and datum features get explicit tolerance callouts. Everything else inherits the general tolerance.
3. Use GD&T where relationships matter. True position, perpendicularity, and concentricity callouts define inter-feature relationships that bilateral tolerances can't. If a bore needs to be within 0.002 in. true position of a datum face, say that. Don't just tighten the linear dimensions and hope the relationship works out.
4. Specify surface finish only where required. "Ra 0.8 µm all over" is expensive. Most surface finishes on non-critical faces can stay at as-machined (Ra 1.6-3.2 µm). Call out the specific Ra only on sealing surfaces, bearing journals, or aesthetic faces.
5. Talk to your machinist before finalizing the drawing. A 5-minute conversation about which features are functional and which are just for show can save thousands on a production run. Good suppliers (including FlagShip's engineering team) offer DFM feedback that flags tolerance callouts which add cost without adding value.
Some industries can't afford to loosen tolerances. The function, safety, or regulatory requirement demands precision.
Aerospace and defense: Actuator bores, hydraulic valve bodies, landing gear bushings, and turbine disk slots all require Tier 2-3 precision with full traceability. AS9100D quality systems and First Article Inspection (FAI) per AS9102 are standard requirements.
Medical devices: Orthopedic implant mating surfaces (hip cups, spinal interbody cages), surgical instrument pivot points, and diagnostic equipment housings need Tier 2-3 precision. ISO 13485 traceability from raw material certification through final CMM report is mandatory.
Semiconductor equipment: Wafer handling fixtures and chamber components require Tier 3-4 precision with surface finishes below Ra 0.4 µm. Cleanliness specifications add another layer of complexity.
Hydraulics and fluid power: Spool bores, piston lands, and port faces in hydraulic manifolds need Tier 2-3 precision to prevent internal leakage. A bore that's 0.001 in. oversize creates a leak path that reduces system efficiency measurably.
For most consumer products and general industrial applications, standard tolerance is perfectly adequate. Paying for precision on a non-critical enclosure or mounting bracket is budget that could be spent on the features that actually matter.
Standard CNC machining holds ±0.005 in. (±0.127 mm) per ISO 2768 medium. Precision CNC machining holds ±0.001 in. (±0.025 mm) or tighter on critical dimensions. The difference involves slower feed rates, additional finishing passes, temperature-controlled environments for tight work, and CMM inspection instead of caliper spot-checks.
Standard CNC mills and lathes achieve ±0.001 in. reliably. With specialized equipment and climate-controlled conditions, ±0.0005 in. is achievable. Ultra-precision work (±0.0001 in.) typically requires secondary operations like jig grinding, lapping, or honing after the initial CNC operation.
Three reasons: slower machining (lower feed rates, more finishing passes, spring passes), longer inspection (CMM programming and multi-point measurement instead of caliper spot-checks), and environmental control (temperature management to prevent thermal growth from eating the tolerance budget). Each tier tighter roughly doubles the per-feature cost.
Hardened tool steels (4140, A2, D2) and free-machining stainless steels (303, 416) hold precision best due to high rigidity and moderate thermal expansion. Aluminum alloys machine well but expand significantly with temperature changes (CTE 13 µin./in./°F). Plastics are the most challenging, with high CTE and moisture absorption affecting dimensional stability.
No. Use a general tolerance block (±0.005 in.) for the drawing and only call out tighter tolerances on functional features: bearing bores, mating surfaces, press-fit diameters, and datum references. Blanket tight tolerances across all dimensions can inflate machining cost 30-50% unnecessarily.
The measurement instrument must be at least 10 times more precise than the tolerance being verified. For a ±0.001 in. tolerance, you need a gauge with ±0.0001 in. resolution. This means calipers (±0.0005 in.) are inadequate for precision work; you need micrometers or CMM.
Ask three questions: What is your CMM capability and when was it last calibrated? Can you provide a First Article Inspection report per AS9102? What is your Cpk (process capability index) on similar features? A Cpk above 1.33 means the process consistently produces parts within tolerance. Below 1.0 means you'll see rejects.
Standard as-machined finish is Ra 1.6-3.2 µm (63-125 µin.). Precision finishing achieves Ra 0.4-0.8 µm (16-32 µin.) with optimized cutting parameters. Mirror finishes (Ra 0.1-0.2 µm) require secondary polishing or lapping after machining.