{"id":2969,"date":"2019-03-10T06:43:07","date_gmt":"2019-03-10T13:43:07","guid":{"rendered":"http:\/\/exhaustnotes.us\/blog\/?p=2969"},"modified":"2024-11-30T14:16:23","modified_gmt":"2024-11-30T22:16:23","slug":"applying-taguchi-to-load-development","status":"publish","type":"post","link":"https:\/\/exhaustnotes.us\/blog\/index.php\/2019\/03\/10\/applying-taguchi-to-load-development\/","title":{"rendered":"Applying Taguchi to Load Development"},"content":{"rendered":"<h6>By Joe Berk<\/h6>\n<p>People reload ammunition for different reasons. \u00a0 It used to be you could save money by reloading, and I suppose for the more exotic cartridges (any Weatherby ammo, the big elephant rounds like .458 Win Mag, the .416 Rigby, etc.) that&#8217;s still the case.\u00a0 It&#8217;s not the case for the more common rounds like 9mm, .45 ACP, and .223 Remington; bulk ammo for those is so inexpensive you&#8217;d be hard pressed to reload for as little as that ammo costs.\u00a0 Sometimes people reload because factory ammo is no longer available or it&#8217;s very tough to find.\u00a0 But most of us reload for accuracy.\u00a0 We can experiment with different combinations of components and tailor a combo to a particular firearm to find the sweet spot&#8230;that combination of components that provides the tightest groups.\u00a0 I&#8217;m in that category; it&#8217;s why I reload.<\/p>\n<p>When I&#8217;m testing for accuracy and I get a tight group, I always wonder:\u00a0 Is it because of the combination of components, or is it just a random event?\u00a0 Usually, if the group size is repeatable, we conclude that it is the component combination, and not just a random good group that results from all the planets coming into alignment.\u00a0 But is there a better way? \u00a0 You know, one that shows with more certainty that it&#8217;s the component combination, and not just a fluke?<\/p>\n<p>This article is a bit different.\u00a0 It&#8217;s not just a story about a gun or about reloading ammunition.\u00a0 It includes those things, but it&#8217;s more.\u00a0 This story is about applying the Taguchi design of experiments technique to .45 ACP load development for ammo to be used in a Smith and Wesson Model 25 revolver (the one you see in the photo above).<\/p>\n<p>I&#8217;m guessing you probably never heard of Taguchi.\u00a0 That&#8217;s okay; most folks have not.\u00a0 Taguchi testing is a statistical design of experiments approach that allows evaluating the impact of several variables simultaneously while minimizing sample size.\u00a0 The technique is often used in engineering development activities, and I used it regularly when I was in the aerospace world.\u00a0 The technique was pioneered by Genichi Taguchi in Japan after World War II, and made its way to the US in the mid-1980s.\u00a0 I used the Taguchi technique when I ran engineering and manufacturing groups in Aerojet Ordnance (a munitions developer and manufacturer) and Sargent Fletcher Company (a fuel tank and aerial refueling company).<\/p>\n<p>Taguchi testing is a powerful technique because it allows identifying which variables are significant and which are not. \u00a0 Engineers are interested in both.\u00a0 It lets you know which variables you need to control tightly during production (that is, which tolerances have to be tight), and it identifies the others that are not so critical.\u00a0 Both are good things to know. If we know which variables are significant and where they need to be, we can change nominal values, tighten tolerances, and maybe do other things to achieve a desired output. If we know which variables are not significant, it means they require less control. \u00a0 We can loosen tolerances on these variables, and most of the time, that means costs go down.<\/p>\n<p>Like I said above, I used Taguchi testing in an engineering and manufacturing environment with great success.\u00a0 The Taguchi approach did great things for us.\u00a0 When I worked in the cluster bomb business, it allowed us to get the reliability of our munitions close to 100%. \u00a0 When I worked in a company that designed and manufactured aerial refueling equipment (think the refueling scene in the movie, <em>Top Gun<\/em>), it helped us to identify and control factors influencing filament-wound F-18 drop tanks.\u00a0 In that same company, it helped us fix a 20-year-old reliability problem on a guillotine system designed to cut and clamp aerial refueling hoses if failures elsewhere in the refueling system prevented rewinding the hose.\u00a0 You don&#8217;t want to land in an airplane trailing a hose filled with JP4 jet fuel.\u00a0 Good stuff, Taguchi testing is.<\/p>\n<p><iframe src=\"https:\/\/www.youtube.com\/embed\/ufOUxbLfyyM\" width=\"716\" height=\"403\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p><iframe src=\"https:\/\/www.youtube.com\/embed\/PkrZEU9e6Iw\" width=\"541\" height=\"403\" frameborder=\"0\" allowfullscreen=\"allowfullscreen\"><\/iframe><\/p>\n<p>As you know from reading our other <a href=\"http:\/\/exhaustnotes.us\/Guns.html\">Tales of the Gun<\/a> stories, the idea in reloading is to find the secret sauce&#8230;the perfect recipe of bullet weight, propellant, brass case manufacturer, and more, to find the best accuracy for a given firearm. \u00a0 Hey, I thought&#8230;I could apply the Taguchi technique to this challenge.<\/p>\n<p>When you do a Taguchi experiment, you need to define a quantifiable output variable, and you need to identify the factors that might influence it.\u00a0 The output variable here is obvious:\u00a0 It&#8217;s group size on the target. \u00a0The input variables are obvious, too.\u00a0 They would include propellant type, propellant charge, primer type, bullet weight, brass type, bullet seating depth, and bullet crimp.\u00a0 We&#8217;re trying to find which of these factors provides the best accuracy.\u00a0 I wanted to turn my Model 25 Smith and Wesson into a hand-held tack driver.<\/p>\n<figure id=\"attachment_2974\" aria-describedby=\"caption-attachment-2974\" style=\"width: 600px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"wp-image-2974 size-full\" src=\"http:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/02\/IMG_0036-600.jpg\" alt=\"\" width=\"600\" height=\"400\" srcset=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/02\/IMG_0036-600.jpg 600w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/02\/IMG_0036-600-300x200.jpg 300w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><figcaption id=\"caption-attachment-2974\" class=\"wp-caption-text\">The Model 25 is an N-frame Smith and Wesson revolver chambered for the .45 ACP pistol cartridge. It is a superbly accurate handgun, as attested to by the target above.<\/figcaption><\/figure>\n<p>When Taguchi developed his testing approach, he made it simple for his followers. \u00a0 One of the things he did was define a simple test matrix, which he called an L8 orthogonal array.\u00a0 It sounds complicated, but it&#8217;s not.\u00a0 It just means you can evaluate up to seven different input variables with each at two different levels.\u00a0 That&#8217;s a bit complicated, but understanding it is a little easier if you see an example. \u00a0 Here&#8217;s what the standard Taguchi L8 orthogonal array\u00a0 (along with the results) looked like for my Model 25 load development testing:<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-28626\" src=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/1-1.jpg\" alt=\"\" width=\"600\" height=\"263\" srcset=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/1-1.jpg 600w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/1-1-300x132.jpg 300w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<p>As the above table shows, three sets of data were collected.\u00a0 I tested each load configuration three times (Groups A, B, and C), and I measured the group size of each 3-shot group.\u00a0 Those group sizes became the output variables.<\/p>\n<p>The next step involved taking the above data and doing a\u00a0standard Taguchi ANOVA (that&#8217;s an acronym for analysis of variance).\u00a0 ANOVA is the statistical method used for evaluating the output data (in our case, the group sizes) to assess which of the above input variables most influenced accuracy.\u00a0 That&#8217;s a complex set of calcs greatly simplified by using Excel. \u00a0 The idea here is to find the factor with the largest ANOVA result. \u00a0 You see, any time you measure a set of results, there&#8217;s going to be variation in the results.\u00a0 Where it gets complicated is the variation can be due to randomness (the variation in the results that would occur if you left all of the inputs the same).\u00a0 Or, the variation can be due to something we changed.\u00a0 We want to know if the differences are due to something we did (like changing or adjusting a component) or if they are due to randomness alone. \u00a0 I cranked through the ANOVA calcs with Excel, and here&#8217;s what I obtained&#8230;<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-28627\" src=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/2.jpg\" alt=\"\" width=\"600\" height=\"258\" srcset=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/2.jpg 600w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/2-300x129.jpg 300w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<p>The above results suggest that crimping (squeezing the bullet by slightly deforming the case mouth inward) has the greatest effect on accuracy (it had the largest ANOVA calculated result).\u00a0 The results suggest that cartridges with no crimp are more accurate than rounds with the bullet crimped.\u00a0 But it&#8217;s a suggestion only; it doesn&#8217;t mean it&#8217;s true. \u00a0 The next step is to evaluate if the differences are\u00a0statistically significant, and doing that requires the next step in the ANOVA process.\u00a0 This gets really complicated (hey, I&#8217;m an engineer), but the bottom line is that we&#8217;re going to calculate a number called the f-ratio, and then compare our calculated f-ratio to a reference f-ratio.\u00a0 If the calculated f-ratio (the one based on the test results above) exceeds the reference f-ratio, it means that crimping versus no crimping makes a statistically significant difference in accuracy.\u00a0 If it not not exceed the reference f-ratio, it means the difference is due to randomness. \u00a0\u00a0Using Excel&#8217;s data analysis feature (the f-test for two samples, for you engineers out there) on the crimp-vs-no-crimp results shows the following:<\/p>\n<p><img decoding=\"async\" class=\"aligncenter size-full wp-image-28628\" src=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/3.jpg\" alt=\"\" width=\"600\" height=\"283\" srcset=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/3.jpg 600w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/3-300x142.jpg 300w\" sizes=\"(max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 984px) 61vw, (max-width: 1362px) 45vw, 600px\" \/><\/p>\n<p>Since the calculated f-ratio (3.817) does not exceed the critical f-ratio (5.391), I could not conclude that the findings are statistically significant.\u00a0 What that means is that the difference in accuracy for the crimped versus uncrimped rounds is due to randomness alone.<\/p>\n<p>Whew! \u00a0So what does all the above mean?<\/p>\n<p>All right, here we go.\u00a0 This particular revolver shot all of the loads extremely well. Many of the groups (all fired at a range of 50 feet) were well under an inch.\u00a0 Operator error (i.e., inaccuracies resulting from my unsteadiness) overpowered any of the factors evaluated in this experiment.\u00a0 In other words, my unsteadiness was making a far bigger difference than any change in the reloading recipe.<\/p>\n<p>Although the test shows that accuracy results were not significantly different, this is good information to know. What it means is that all of the test loads (the different reloading recipes) are reasonably accurate.\u00a0 If I had used a machine rest, I might have seen a statistically significant difference.\u00a0 Stated differently, the test told me that I needed to use a machine rest with this gun to see which load parameters were really playing a role in accuracy.\u00a0 Without it, my flaky shooting skills (or as the statisticians like to say, my randomness) overpowered any accuracy gains to be realized by playing with component\u00a0 factors.<\/p>\n<p>That said, though, I like that 4.2 grains of Bullseye load with the 200 grain semi-wadcutter bullet, and it&#8217;s what I load for my Model 25.\u00a0 But I now know&#8230;the gun shoots any of these loads well, and crimping versus no crimping doesn&#8217;t really make a difference.<\/p>\n<hr \/>\n<p>Check out our other <a href=\"http:\/\/exhaustnotes.us\/Guns.html\">Tales of the Gun stories here<\/a>.<\/p>\n<hr \/>\n<p>Join our <a href=\"https:\/\/www.facebook.com\/groups\/528366535451405\">Facebook ExNotes page<\/a>!<\/p>\n<hr \/>\n<p>Never miss an ExNotes blog:<\/p>\n<hr \/>\n<h3 style=\"text-align: center;\"><span style=\"color: #ff0000;\">Help us keep the lights on:<\/span><\/h3>\n<style>\r\n        .wpedon-container .wpedon-select,\r\n        .wpedon-container .wpedon-input {\r\n            width: 171px;\r\n            min-width: 171px;\r\n            max-width: 171px;\r\n        }\r\n    <\/style><div class='wpedon-container wpedon-align-center'><form target='_blank' action='https:\/\/www.paypal.com\/cgi-bin\/webscr' method='post' class='wpedon-form'><input type='hidden' name='cmd' value='_donations' \/><input type='hidden' name='business' value='ExNotes@ExhaustNotes.us' \/><input type='hidden' name='currency_code' value='USD' \/><input type='hidden' name='notify_url' value='https:\/\/exhaustnotes.us\/blog\/wp-admin\/admin-post.php?action=add_wpedon_button_ipn'><input type='hidden' name='lc' value='en_US'><input type='hidden' name='bn' value='WPPlugin_SP'><input type='hidden' name='return' value='' \/><input type='hidden' name='cancel_return' value='' \/><input class='wpedon_paypalbuttonimage' type='image' src='https:\/\/www.paypal.com\/en_US\/i\/btn\/btn_donateCC_LG.gif' border='0' name='submit' alt='Make your payments with PayPal. It is free, secure, effective.' style='border: none;'><img alt='' border='0' style='border:none;display:none;' src='https:\/\/www.paypal.com\/en_US\/i\/scr\/pixel.gif' width='1' height='1'><input type='hidden' name='amount' id='amount_2c4ab03837ed60f01d176c4fc9707f66' value='' \/><input type='hidden' name='price' id='price_2c4ab03837ed60f01d176c4fc9707f66' value='' \/><input type='hidden' name='item_number' value='' \/><input type='hidden' name='item_name' value='' \/><input type='hidden' name='name' value='' \/><input type='hidden' name='custom' value='23447'><input type='hidden' name='no_shipping' value='1'><input type='hidden' name='no_note' value='0'><input type='hidden' name='currency_code' value='USD'><\/form><\/div>\n<hr \/>\n<h3 style=\"text-align: center;\"><span style=\"color: #ff0000;\">Don&#8217;t forget: Visit our advertisers!<\/span><\/h3>\n<hr \/>\n<p><a href=\"https:\/\/www.britishmotorcyclegear.com\"><img decoding=\"async\" class=\"aligncenter wp-image-23940 size-full\" src=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2023\/09\/BritishMotorcycleGear400.jpg\" alt=\"\" width=\"400\" height=\"400\" srcset=\"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2023\/09\/BritishMotorcycleGear400.jpg 400w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2023\/09\/BritishMotorcycleGear400-300x300.jpg 300w, https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2023\/09\/BritishMotorcycleGear400-150x150.jpg 150w\" sizes=\"(max-width: 400px) 85vw, 400px\" \/><\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>By Joe Berk People reload ammunition for different reasons. \u00a0 It used to be you could save money by reloading, and I suppose for the more exotic cartridges (any Weatherby ammo, the big elephant rounds like .458 Win Mag, the .416 Rigby, etc.) that&#8217;s still the case.\u00a0 It&#8217;s not the case for the more common &hellip; <a href=\"https:\/\/exhaustnotes.us\/blog\/index.php\/2019\/03\/10\/applying-taguchi-to-load-development\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;Applying Taguchi to Load Development&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":28629,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[235,84],"tags":[87,605,189,606],"class_list":["post-2969","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-amazon","category-guns","tag-45-acp","tag-sw-model-25","tag-smith-and-wesson","tag-taguchi"],"jetpack_featured_media_url":"https:\/\/exhaustnotes.us\/blog\/wp-content\/uploads\/2019\/03\/IMG_0691-900.jpg","jetpack_sharing_enabled":true,"post_mailing_queue_ids":[],"_links":{"self":[{"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2969","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/comments?post=2969"}],"version-history":[{"count":14,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2969\/revisions"}],"predecessor-version":[{"id":28630,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/posts\/2969\/revisions\/28630"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/media\/28629"}],"wp:attachment":[{"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/media?parent=2969"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/categories?post=2969"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/exhaustnotes.us\/blog\/index.php\/wp-json\/wp\/v2\/tags?post=2969"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}