SINGLE CYLINDER ENGINE TESTS FOR EVALUATING THE PERFORMANCE OF CRANKCASE LUBRICANTS (Abridged Procedures) ASTM Approved, b u t not a Standard Sponsored by Section I on Engine Oils of Technical Division B on Automotive Lubricants of ASTM Committee D-2 on Petroleum Products and Lubricants ASTM SPECIAL TECHNICAL PUBLICATION 509 List price $5.00 04-509000-12 % AMERICAN SOCIETY FOR TESTING AND MATERIALS 1916 Race Street, Philadelphia, Pa 19103 ANNlVERSARy Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized © BY AMERICAN SOCIETY FOR TESTING AND MATERIALS 1972 Library of Congress Catalog Card Number 75-189600 Printed in Alpha, N J March 1972 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized Foreword The test methods described in this puhlication have not been subjected to the ASTM Standardization Procedure They are not standards or standard recommended practices of the American Society of Testing and Materials (ASTM) The heavy duty non-corrosive compounded oils introduced in 1939 or earlier were the basis for the first specification oils Caterpillar and General Motors were the first engine manufacturers to approve compounded crankcase lubricating oils on the basis of satisfactory performance in laboratory engine tests These early manufacturer specifications were also the basis for the first military specification oils which were introduced in 19^1 Over the years, performance standards have been raised as required to meet new service operating conditions and/or the requirements of new engine designs Since these engine procedures, serving as a basis for many manufacturer's and military specifications, were not available in a singlepublication in a convenient form and since these procediires have been the subject of a nimiber of changes and additions Section I on Engine Oils of Technical Division B recommended in I967 that they be made available as an ASTM special technical publication This ASTM format will permit the periodic updating of the single-cylinder test proced\ires, including an analysis of test precision, for the benefit of the petroleum and automotive industries and the consumer The present printing represents the first of these publications In submitting this current STP, the panel recognized and wishes to specifically draw attention to the fact that the data which form the basis for these statistical analyses was obtained in actual engine tests conducted in two time periods The original data covers tests conducted in or prior to 196T; the up-dated precision data covering the Caterpilleir Test No 1-H and the Caterpillar Test No 1-G (see Tables X to XII -, Section IV for the 1-H; see Tables XVI fo XVIII Section V for the l-G) cover in addition the period through December 1970 Since refinements in engine test techniques, changes in lubricant technology, improvements in engine metallurgy, and shifts in test objectives (to cite a few factors) are constantly occurring in this dynamic field; it is important to emphasize that the precision picture derived by the panel's study is certainly not to be construed as reflecting the current (December 1970) variability of single cylinder engine tests Accordingly, the panel recommends that continuing efforts be directed towards up-dating our knowledge of the precision of single cylinder engine tests (just as is currently done for the IIB-IIIB and VB) - Ill Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized NOTE: The Society is not responsible, as a body, for the statements and opinions advanced in this publication Not ASTM Standards - IV Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized CONTENTS Foreword Introduction iii vii Section I FTMd) 3^05.1 - Oxidation (CRC L-38 Test) Scope Summary Significance Definitions Apparatus Reagents and Materials Preparation of Apparatus Calibration Procedure Inspection of Engine after Test Data Sheet Report Forms Statistical Analysis I_l I_l 1-1 See Appendix F-2 VI-3 1-2 1-2 1-3 1-3 I-l^ 1-k I-it 1-8 Section II F T M ( I ) 3U8T-568 - Low Temperature Deposits (CRC LTD Test) Scope Simmary Significance Definitions Apparatus Reagents and Materials Preparation of Apparatus Calibration Procedure Inspection of Engine after Test Data Sheet Report Forms Statistical Analysis II-l II-l II-l See Appendix F-2 VI-3 II-2 II-2 II-3 II-3 II-3 II-i| II-5 II-8 Section III F T M ( ) 3^+0.2 - Ring Sticking, Wear and Deposit Diesel Test (Caterpillar Test No 1-D) Scope Summary Significance Definitions Apparatus Reagents and Materials Preparation of Apparatus Calibration Procedure Inspection of Engine after Test Data Sheet Report Forms Statistical Analysis III-l III-l III-l See Appendix F-2 VI-3 III-2 III-2 III-2 III-3 III-3 III-3 III-U III-IO - V Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized CONTENTS (Continued) Section IV F T M ( ) 3^+6 - Ring Sticking, Wear and Deposit Diesel Test (Caterpillar Test No 1-H) Scope Summary Significance Definitions Apparatus Reagents and Materials Preparation of Apparatus Calibration Procedure Inspection of Engine after Test Data Sheet Report Forms Statistical Analysis IV-1 IV-1 IV-1 See Appendix F-2 VI-3 IV-2 IV-2 IV-2 IV-3 IV-3 IV-3 IV-U IV-5 Section V FTwd) 3^^1.2 - Ring Sticking, Wear and Deposit Diesel Test (Caterpillar Test No 1-G) Scope Siamnary Significance Definitions Apparatus Reagents and Materials Preparation of Apparatus Calibration Procedure Inspection of Engine after Test Data Sheet Report Forms Statistical Analysis See Appendix F-2 V-1 V-1 V-1 VI-3 V-2 V-2 V-2 V-3 V-3 V-3 V-U V-5 Section VI - Appendices Safety Definitions Statistical Procediires, Definitions, Rating Methods, Computational Examples (1) FTM — (Appendix F-l) VI-1 (Appendix F-2) VI-3 (Appendix F-3) VI-5 Federal Test Method - VI Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized SINGLE-CYLINDER ENGINE TESTS FOR EVALUATING THE PERFORMANCE OF CRANKCASE LUBRICANTS Prepared by Section I of Technical Division B of ASTM Committee D-2 Not ASTM Standards This report provides a brief description of the engine test procedures used to qualify crankcase lubricants against MIL-L-210UB, MIL-L-U6152, MIL-L-it5199B, and MIL-L-210UC; specifications established by the U.S Army Materiel Command (AMC) Federal Test Method 3^+05.1 (CRC L-38 Test) employs a single-cylinder CLR Oil Test Engine for defining the oxidation resistance, corrosive tendencies, and the deposit control characteristics of crankcase lubricants under conditions of high-speed, high temperature operation Federal Test Method 3U8T-568 (CRC-LTD) also employs a single-cylinder CLR Oil Test Engine Operation of the engine under Method 3^8T-568 is at steady speed and constant load; however, the jacket coolant temperatiire is cycled between cold and hot operation This test is useful in defining the sludge deposition characteristics of crankcase lubricants Three of the single-cylinder tests employ two versions of a Caterpillar diesel engine to assess the performance of crankcase lubricants with respect to detergency, wear and piston ring sticking The tests employed for these evaluations are: Federal Test Method^!) Std No T91a Engine RPM FTM-3UO.2 (Caterpillar Test No ID) FTM-3it6 (Caterpillar Test No IH) FTM-3i+1.2 (Caterpillar Test No IG) 1200 I8OO I8OO BMEP • 13^+ 110 137 Fuel S % 0.95-1.05 0.35-0.^5 0.35-0.1+5 Qualification crankcase oils are required to meet minimum acceptable standards as determined by the judgment of the AMC "Review Board." Shown below are the various engine tests required for the approval of an oil against MIL-L-210liB, MIL-L-U6152, MIL-L-U5199B and MIL-L-210UC specifications In addition some of these test methods are used to describe the (1) Complete unabridged copies of this standard and methods may be ordered from GSA Business Service Centers in Boston, New York, Atlanta, Chicago, Kansas City, Mo., Dallas, Denver, San Francisco, Los Angeles, and Seattle, Washington - vii Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized new API service Classes (SA-SE and CA-CD)(2) and some are used by engine builders for describing minimum lubricant performance levels for gasoline and diesel service Engine Test CLR L-38 CLR LTD Caterpillar Test No 1-H Caterpillar Test No 1-D Caterpillar Test No 1-G General Motors I I B ( ) General Motors Seq 3C(3) Ford Seq VC(3) Military Specification Lubricants MIL L-210itB MIL L-U6152 MIL L-U5199B MIL-.L-210i+C X X X X X X X X X X X X X X X X X (2) See Engine Oil Performance Classifications, ASTM Research Report RR D-2:1002, Section 1, Technical Division B-ASTM Committee D-2, December 1970 (3) Details of these test procedures are given in ASTM publication STP-315E - viii Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized S E C T I O N - I OXIDATION CHAEACTERISTICS OF CRMKCASE LUBRICATING OILS ORG Copyright by ASTM Int'l (all rights Downloaded/printed by University of Washington (University of reserved); Fri Washington) L-38 Jan pursuant TEST to 23:05:28 License EST 2016 Agreement No further reproductions authorized STP509-EB/Mar 1972 DEFINITIONS FOR SINGLE CYLINDER TESTS STP Blowby That portion of the combustion reactants and unburned airfuel mixture which leak into the engine crankcase during operation of the engine Carton A firm, black, amorphous deposit normally having no luster Clogging Restriction of a flow path due to the accumulation of debris along the flow path boundaries Corrosion Any observed chemical attack on the metal parts special case of the corrosion of iron Lacquer A hard, dry, lustrous oil insoluble deposit which cannot be removed by light wiping with a cloth Normally used in rating diesel engines Ring, free One that falls of its own weight from side to side in its groove Ring, stuck One that is either partially or completely bound in its groove Ring, tight One that offers resistance to movement in its groove, but which can be pressed into or out of the groove under finger pressure without springing back Rust The chemical combination of oxygen with ferrous engine parts, including other iron complexes not removable by organic solvents Scoring A condition resulting from metal to metal contact or foreign matter causing surface roughness in the direction of relative motion characterized by dragging and smearing of the material of one or both surfaces Scuffing Adhesive wear It is the result of progressive removal of material from a rubbing surface caused by localized welding and subsequent fracture Sludge A deposit, principally composed of engine oil and fuel debris, which does not drain from engine parts but can be removed by wiping with a soft cloth Varnish A hard, dry, generally lustrous oil insoluble deposit which cannot be removed by wiping with a soft cloth Normally used in rating gasoline engines Wear The loss of material from two or more surfaces in relative motion VI-lt Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Copyright Downloaded/printed by 61972 by ASTM International www.astm.org University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized Rust is a A P P E N D I X F-3 STATISTICAL PROCEDURES AUD DEFINITIONS The IP Demerit Rating System The "K" Factor Equation Statistical Terms and Formulations Used in this Publication h Computational Factor Table and Example of Calculation of "s" and "r" from "K" Factors VI-5 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized STP509-EB/Mar 1972 GLOSSARY OF SYMBOLS AND TERMS GENERALLY USED IN THE STATISTICAL ANALYSIS OF RESULTS FROM STANDARDIZED ENGINE TESTING Symbol General Meaning n The number of test runs (observations) k The number of paired test runs (repeat runs made using the same oil, same procedure, same laboratory, etc.) X The arithmetic mean or average s An estimate of the true standard deviation in a finite set Any finite set is considered to be a sub-set from the infinite set s2 An estimate of the true variance in a finite set Any finite set is considered to be a sub-set from the infinite set df Degrees of Freedom V Coefficient of Variation d The difference (delta) between duplicate measurements r Repeatability, the measure of precision within a single laboratory R Reproducibility, the measure of lab-to-lab precision P Probability m Multiplier of the estimate of the standard deviation for calculating the greatest difference between two results at the 95% confidence limit CL Confidence limits 95$ confidence limits are used in ASTM work F The F distribution (ratio) describes the behavior of the ratio of two Chi squared variables It is used for comparing two sample variances "t" "Student's t": the ratio of the difference between the averages to the standard deviation of this difference Used for comparing Sample means by assuming equality of variances VI-6 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by 61972 by ASTM International Copyright www.astm.org University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized APPEM)IX F-3 The IP Rating System The data for all Caterpillar tests generally was submitted on standard rating forms Only the top ring groove percentage volume filled is given as a numerical value and suitable for statistical evaluation Deposits are usually given as a descriptive assessment on carbon, lacquer and color It was, therefore, necessary to introduce a numerical rating system to have a single numerical value assigned to each zone of the piston to permit statistical analysis The oil industry has various numerical rating systems to assess the observed deposits on engine components; they are usually based on arbitrary weighting factors for typical deposits (i.e., carbon, lacquer, color, volume, area, etc.) These n\imerical values give a direct demerit to the zone or component of the engine; this is usually converted to a merit value; subtracting from a number representing no deposits For this study, a demerit rating system was retained as the zones of deposits were of interest rather than the zones remaining without deposits; this also minimized the numerical work Several alternate type procediires which serve to convert descriptive ratings to some numerical basis are available within the industry For this work, the IP demerit type system was chosen since it was already available in published form from the Institute of Petroleim, London (1) It has already seen wide usage (principally in the IP sphere of influence) Following is a tabulation of the numerical factors assigned for conversion of descriptive terms to the IP demerit system (l) IP 2UT/69, Merit Rating System for Engine Cleanliness and Wear, Institute of Petrole\:im, London, 1969« VI-T Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized IP DEMERIT RATING SYSTEM Abrev Appearance Deposit HC MC LC BL BrL AL LAL VLAL Clean Black Black Black Black Dark Brown Brown Light Brown Transparent Clean Heavy Carbon (=100^) Medium Carbon (=50^) Light Carbon {=23%) Black Lacquer Brown Lacquer Amber Lacquer Light Amber Lacquer Very Light Amber Lacquer Nil Proposed Demerit Rating - Used in Study(2) (Max.=10) 1.0 1.0 1.0 1.0 0.75 0.50 0.25 0.10 0.0 (2) The overall rating for a zone is calculated from: X = (Area covered x Color factor) 10 with a maximum demerit of 10.0 resialting for carbon or black lacquer area covered in VI-8 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized ON o (-1 ON U + "5 + CO H H I CO pq CO H ^^ oo O H LA H TZf o JlA CM o CM CM H O > Lr\ ml CM O CM o\ CM II H t^ ^ %^ OD •p H •H II (U CO -P ãH CQ O ô > O O U o o o Hi ãH a) ãH ô P EH o to •p •H (0 O P CM lA CM lA LA 00 CO u 0) > O o 0) a o H H 0) ^ (U LA CM 00 H H A + LA CM CM II pq en ^^ 00 + LA X > ^^ LA CM l A CM II +J •H ^ > O o !H > o o h CJ C5 C5 bC C ãH bC C! ãH bC ô PH ô fO -d Tj a O a o a o (U CO 0) CQ a ãH o CM i-q o o H II TJ LA t- O LA —I >H + o OO + II + X OO H -p •H + O H LA 00 H bC P o a Q o 0) CM Q) bO OS U OO OO + CO H LfN + CJ O H o II O + CM CO + CO 0) lA H + Lr\ pq MD ^- ir\ H o OO LTN CM pq ITS CM LTN LPi J - H H LA CO m H X LPl CO CQ O P 0) O a i-q •p CQ 0) > o a •p CQ !H •H •H M -p CO VI-9 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized II o OO O OO • CO H 00 + THE K FACTOR EQUATION AND METHOD OF COMPUTATION OF THE STANDARD DEVIATION FROM "K" FACTORS BY PISTON ZONE The following illustrates the basis for deriving the factors which are used as multipliers to compute estimates of the Standard Deviation in Caterpillar Precision Analysis from K factors when using the equation: = KfX (C-X) K = Reproducibility or repeatability coefficient evaluated for each piston zone s = Estimate of the Standard Deviation X = Mean of two observations for the zone of interest C = A constant: C takes the value IDO for zones I & II; C takes the value 10 for zones III-V A statistical analysis was carried out which accounted for the variability of error as a function of demerit level by use of this equation The function X (C-X) arises for a variance (s^) of observations as a parabola against X, symmetrical about the mid-scale value This has the property that s is zero at both ends of the scale, which is necessary to obtain an average of Zero; i.e., for all observations to be Zero, similarly for avereige of 10 all observations must be 10, etc Note that values of s computed for X from to 50 exactly equal values of X from 50 to 100 For that reason only factors up to multipliers for 50 are given When computing s for zones III-V, X values range from to 5j and the factors are exactly 1/10 of the factors shown for the case when 0=100 These factors were used to construct the Standard Deviation Tables VI-10 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized MULTIPLIER FACTOR COMPUTATION X EXAMPLE: (C-X) X(C-X) J x(c:-x) 100 95 475 21 795 10 90 900 30 000 15 85 1275 35.,709 20 80 1600 40 000 25 75 1875 43.,301 30 70 2100 45.,826 35 65 2275 47.,801 40 60 2400 48,,990 45 55 2475 49.,749 50 50 2500 50.,000 For a mean of x values of 20 and 40; X=30 Then s = k>/x(C-X), and at X=30, C=100, the multiplier factor read from the table above is 45.826 If K was applied for a typical Zone I case it might be 0.156 Then s=0.156(45.826)=7.149 VI-11 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized STATISTICAL PROCEDURES AITO DEFINITIONS Utilization of Submitted Precision Data Replicate runs of the same oil made in the same laboratory are defined as repeatability runs Replicate runs made in different laboratories on the same oil are defined as reproducibility runs Thus, an oil run three times in one lab and twice in another would provide three repeatability measurements in the first laboratory, one repeatability measurement in the second laboratory and finally, six reproducibility rims between the two laboratories yielding a total of ten statistically utilizable data pairs These data pairs are then analyzed to provide the variability information For commercial oil data, the differences between results from pairs of identical oils are used to compute the standard deviation and thence the variability of the test technique Conversely with standard reference engine oils, a different statistical analysis is required since each rtin represents a measurement of the characteristics of a single reference material A true mean value for any given test parameter measured can be computed by the conventional statistical techniques and then the variability of the test technique is expressed as the standard deviation about this mean Discussion of Repeatability and Reproducibility REPEATABILITY is a quantitative measure of the variability associated with a single operator in a given laboratory it is defined as the greatest difference between two single and independent test results that can be considered acceptable at the 93% confidence level REPRODUCIBILITY is a quantitative measure of the variability associated with operators working in two different laboratories it is defined as the greatest difference between a single test result obtained in one laboratory and a single test result in another laboratory that need not be considered suspect at the 93% confidence level In order to obtain the reproducibility or the repeatability, it is first necessary to make an estimate of the standard deviation The best estimate is generally calculated from cooperative tests from which 20 to 30 independent test results are available The estimate of the standard deviation is calculated as follows: VI-12 Copyright by ASTM Int'l (all rights reserved); Fri Jan 23:05:28 EST 2016 Downloaded/printed by University of Washington (University of Washington) pursuant to License Agreement No further reproductions authorized s = / n(X^ ™^A-| + x| + X^) T Ao • • • • ^r\ ) n(n-l) where: X^, X , X = individual resxilts, and n = number of test results While the definition of repeatability depends upon the use of a single apparatus, it is not practical to obtain a repeatability standard deviation from a large number of tests by a single operator, using either one or several apparatuses; nor is it reasonable to expect a single operator to be typical for the test in question Hence, estimates of repeatability standard deviations are obtained by combining (pooling) the differences between results from each of several operators in different laboratories, (carrying out the same determination on identical material) from his mean value Under these conditions, the pooled estimate of the repeatability of the standard deviation, s is calculated from the following formula: ^r =- (Xi-X^) + (X2-X2) + + (Xv-Xi,)2 k'-^k^ (n-L-1 + (n2-l) + (n]j-l) In the case where different laboratories are supplying operators who produce a pair of results, differences between two determinations on the same oil yield Deltas which can be used to estimate the repeatability standard deviation In this case, the formula for calculating the estimate of the standard deviation reduces to the simple form: Sj = /< H —^ " ^A - H t)0 03 c; • •H -P CO (U - P o3 (1> + CO •iH 0) ^ 03 > ' O 03 CO • H -H e 03 H •H O (U tn EH M ^ O H 03 fl o o O 0) (U fH (U tH 0) ^H -d 0) N (U O o3 CO EH • H fl H +3 •P -P ft Q) CO CO ft 03 O Xi Q) 4^ ,C| 03 +3 03 • H H O O 03 O O •H •H +3 - P o3 "iH CO 03 ^ tH M o O O U O ft Q> -d 03 Q) (U 0) U 03 +3 CO 03 C0)O 0) - p rt 03 Co o CO • H H (U ft ,a -p ^ -P (U O a d) H -H O (L) - p ^ o3 •H ^ CQ + ) -H to g a u o ^ u o I > -s H (u tn 03 -d CO J 03 -P P> a a OJ OJ ;:! O p! H as (U CO ^ oJ H ,Ci H CO -H -H > d (U H P d • fl - p o 0) O ,c; JH -p (u o ?-l H (U cd H o ft-H CF< Is CQ T:) -P e fl (]) Si • H (u g ^ +j