defaria.com/blogs/Status/2008/03/east-automation.html

   1 <!DOCTYPE html>
   2 <html lang="en-us" itemscope itemtype="http://schema.org/Article">
   3   <head>
   4     <meta charset="utf-8">
   5     <meta name="description" content="What's been done The EAST test automation tool rantest currently can run properly formated EAST tests. By properly formated we mean that they 1) run to completion and 2) report a status in their log file. Logfile collection for EAST...">
   6     <meta name="generator" content="Movable Type 5.2.3">
   7     <title>EAST Automation - Status</title>
   8     <link rel="alternate" type="application/atom+xml" title="Recent Entries" href="http://defaria.com/blogs/Status/atom.xml">
   9     <link rel="canonical" href="http://defaria.com/blogs/Status/2008/03/east-automation.html">
  10     <meta name="viewport" content="width=device-width,initial-scale=1">
  11     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles.css">
  12     <!--[if lt IE 9]>
  13     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles_ie.css">
  14     <script src="/mt/mt-static/support/theme_static/rainier/js/html5shiv.js"></script>
  15     <![endif]-->
  16
  17     <link rel="start" href="http://defaria.com/blogs/Status/">
  18
  19     <link rel="prev" href="http://defaria.com/blogs/Status/2008/03/sharable-vs-non.html" title="Sharable vs Non-sharable derived objects">
  20     <link rel="next" href="http://defaria.com/blogs/Status/2008/03/migrating-coloc.html" title="Migrating colocated views from 6.0 -&gt; 7.0">
  21     <!-- Open Graph Protocol -->
  22     <meta property="og:type" content="article">
  23     <meta property="og:locale" content="en-us">
  24     <meta property="og:title" content="EAST Automation">
  25     <meta property="og:url" content="http://defaria.com/blogs/Status/2008/03/east-automation.html">
  26     <meta property="og:description" content="What's been done The EAST test automation tool rantest currently can run properly formated EAST tests. By properly formated we mean that they 1) run to completion and 2) report a status in their log file. Logfile collection for EAST...">
  27     <meta property="og:site_name" content="Status">
  28     <meta property="og:image" content="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  29     <!-- Metadata -->
  30     <meta itemprop="description" content="What's been done The EAST test automation tool rantest currently can run properly formated EAST tests. By properly formated we mean that they 1) run to completion and 2) report a status in their log file. Logfile collection for EAST...">
  31     <link itemprop="url" href="http://defaria.com/blogs/Status/2008/03/east-automation.html">
  32     <link itemprop="image" href="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  33
  34   </head>
  35   <body>
  36     <div id="container">
  37       <div id="container-inner">
  38         <header id="header" role="banner">
  39           <div id="header-inner">
  40             <div id="header-content">
  41               <h1>
  42                 <a href="http://defaria.com/blogs/Status/">
  43
  44                   Status
  45
  46                 </a>
  47               </h1>
  48
  49             </div>
  50
  51             <nav role="navigation">
  52           <ul>
  53             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
  54
  55
  56           </ul>
  57         </nav>
  58
  59           </div>
  60         </header>
  61         <div id="content">
  62           <div id="content-inner">
  63             <ul class="breadcrumb breadcrumb-list">
  64               <li class="breadcrumb-list-item"><a href="http://defaria.com/blogs/Status/">Home</a></li>
  65               <li class="breadcrumb-list-item">EAST Automation</li>
  66             </ul>
  67             <div id="individual-main" class="main" role="main">
  68               <article id="entry-1948" class="entry entry-asset asset hentry">
  69                 <div class="asset-header">
  70                   <h2 itemprop="name" class="asset-name entry-title">EAST Automation</h2>
  71                   <footer class="asset-meta">
  72                     <ul class="asset-meta-list">
  73                       <li class="asset-meta-list-item">Posted on <time datetime="2008-03-27T10:30:05-08:00" itemprop="datePublished">March 27, 2008</time></li>
  74                       <li class="asset-meta-list-item">by <span class="author entry-author vcard"></span></li>
  75
  76
  77                       <li class="asset-meta-list-item">in <a itemprop="articleSection" rel="tag" href="http://defaria.com/blogs/Status/general-dynamics/">General Dynamics</a></li>
  78
  79
  80                    </ul>
  81                 </footer>
  82                 </div>
  83                 <div class="entry-content asset-content" itemprop="articleBody">
  84                   <h3>What's been done</h3>
  85
  86 <ul>
  87   <li>The EAST test automation tool rantest currently can run <i>properly
  88 formated</i> EAST tests. By <i>properly formated</i> we mean that they
  89 1) run to completion and 2) report a status in their log file.</li>
  90
  91   <li>Logfile collection for EAST tests is performed and a tar file,
  92 EASTLogs.tgz, is created and if run for record (-rfr) specified that
  93 log file will be checked in (coded but untested - see below).</li>
  94
  95   <li>Many tests can be run in succession using the -file option and
  96 specifying multiple tests in the file (See <a
  97  href="http://ranweb/dokuwiki/doku.php?id=ran:rantest">rantest</a> wiki
  98 page).</li>
  99
 100   <li>A rudimentary conditional test execution facility exists. For
 101 example, testers can name tests then refer to them in a subsequent test
 102 with an "if" statement so as to say "run this test if &lt;named
 103 test&gt; passed (See <a
 104  href="http://ranweb/dokuwiki/doku.php?id=ran:rantest">rantest</a> wiki
 105 page).</li>
 106
 107   <li>A facility for running test in the background has been
 108 implemented as some EAST test script must run in the background while
 109 other tests run simultaneously.</li>
 110
 111   <li>A crude rendezvous system has been implemented such that rantest
 112 will poll the logfile looking for a rendezvous string that will
 113 indicate to rantest that the backgrounded test has reached a certain
 114 point and it's OK to proceed with other tests.</li>
 115
 116   <li>Logging of what rantest does has been implemented.</li>
 117
 118   <li>A crude -script test option has been implemented that allows
 119 rantest to "farm out" the verification of a test for tests that
 120 require more complex verification. Any script can be coded. The only
 121 requirement is that it reports success or failure through it's exit
 122 status.</li>
 123
 124   <li>Worked on learning moshell as some verifications require
 125 moshell.</li>
 126
 127   <li>Implemented a simple case of verifying that a cell is set up (a
 128 manual verification step for Sim Cell Setup of preSWIT).</li>
 129
 130   <li>Ngan has created test profiles and Ross Wilson says that we are
 131 going to run these test profiles through rantest this afternoon.</li>
 132
 133   <li>Documented most of <a
 134  href="http://ranweb/dokuwiki/doku.php?id=ran:rantest">rantest</a>'s
 135 usage on the wiki.</li>
 136
 137   <li>Ross and Gantry have created Perl scripts and TPL's such that an
 138 EAST test can drive a TM500. While rantest can run such tests it needs
 139 to be taught how to gather the TM500 log files produced.</li>
 140 </ul>
 141
 142 <h3>What we're impeded on</h3>
 143
 144 <ul>
 145   <li>I believe many of the SWIT tests are not currently properly
 146 formatted. Such tests will need to be altered before they can be truly
 147 automated through rantest</li>
 148
 149   <li>WRT preSWIT testing, I need Leslie to modify her tests to
 150 properly write rendezvous strings in SIM Cell Setup so that rendezvous
 151 can work and sanity/preSWIT testing can proceed.</li>
 152
 153   <li>Gather tests from Ngan (and others) </li>
 154
 155   <li>We often don't have time on the various RNC's/etc. to perform
 156 testing. Some tests, i.e. SIM Cell Setup, are interruptive of other
 157 EAST engineer's work.</li>
 158
 159   <li>Moshell is crude, picky and buggy and... not supported by Ericson!</li>
 160 </ul>
 161
 162 <h3>What's next</h3>
 163
 164 <ul>
 165   <li>Create run for record view and test out -rfr checkin
 166 functionality.</li>
 167
 168   <li>Get EAST/TM500 test to work (currently failing) so as to
 169 check/modify TM500 logfile creation</li>
 170
 171   <li>Get EAST/NMS test to work (currently non-existant?) so as to
 172 check/modify NMS logfile creation.</li>
 173
 174   <li>Implement XML parsing to determine whether or not we have TM500
 175 logs or NMS logs to collect. Either that or get Gantry to change the
 176 format of the message indicating where the logfile is to include what
 177 type of logfile it is.</li>
 178
 179   <li>Once Leslie modifies tests for rendezvous, attempt sanity again
 180 and add in the -script "IsCellUp &lt;machine&gt; &lt;cell&gt;"
 181 verification.</li>
 182
 183   <li>Bob wants us to write a simple and a complex example of test
 184 verification. Based on Doug Elder's <i>How to Analyze rnc</i>
 185 document, implement it's verification steps which get progressively
 186 more complex. The IsCellUp script can also serve as an example
 187 verification script.</li>
 188 </ul>
 189
 190                 </div>
 191                 <nav class="page-navigation entry-navigation pagination content-nav">
 192                   <ul class="page-navigation-list">
 193
 194                     <li class="page-navigation-list-item page-navigation-prev"><a rel="prev" href="http://defaria.com/blogs/Status/2008/03/sharable-vs-non.html" title="Sharable vs Non-sharable derived objects">Previous entry</a></li>
 195
 196
 197                     <li class="page-navigation-list-item page-navigation-next"><a rel="next" href="http://defaria.com/blogs/Status/2008/03/migrating-coloc.html" title="Migrating colocated views from 6.0 -&gt; 7.0">Next entry</a></li>
 198
 199                   </ul>
 200                 </nav>
 201                 <!--
 202 <aside id="zenback" class="zenback feedback">
 203   Please paste Zenback script code here.
 204 </aside>
 205 -->
 206
 207
 208               </article>
 209             </div>
 210             <aside class="widgets related" role="complementary">
 211               <nav class="widget-search widget">
 212   <div class="widget-content">
 213     <form method="get" id="search" action="http://defaria.com/mt/mt-search.cgi">
 214       <div>
 215         <input type="text" name="search" value="" placeholder="Search...">
 216
 217         <input type="hidden" name="IncludeBlogs" value="8">
 218
 219         <input type="hidden" name="limit" value="20">
 220         <button type="submit" name="button">
 221           <img alt="Search" src="/mt/mt-static/support/theme_static/rainier/img/search-icon.png">
 222         </button>
 223       </div>
 224     </form>
 225   </div>
 226 </nav>
 227 <nav class="widget-archive-category widget">
 228   <h3 class="widget-header">Categories</h3>
 229   <div class="widget-content">
 230
 231
 232     <ul class="widget-list">
 233
 234
 235       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/ameriquest/">Ameriquest (99)</a>
 236
 237
 238       </li>
 239
 240
 241
 242
 243       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/audience/">Audience (3)</a>
 244
 245
 246       </li>
 247
 248
 249
 250
 251       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/broadcom/">Broadcom (76)</a>
 252
 253
 254       </li>
 255
 256
 257
 258
 259       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/gpdb/">GPDB (35)</a>
 260
 261
 262       </li>
 263
 264
 265
 266
 267       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-dynamics/">General Dynamics (61)</a>
 268
 269
 270       </li>
 271
 272
 273
 274
 275       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-electric/">General Electric (13)</a>
 276
 277
 278       </li>
 279
 280
 281
 282
 283       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/hewlett-packard/">Hewlett Packard (13)</a>
 284
 285
 286       </li>
 287
 288
 289
 290
 291       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/lynuxworks/">LynuxWorks (162)</a>
 292
 293
 294       </li>
 295
 296
 297
 298
 299       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/pqa/">PQA (35)</a>
 300
 301
 302       </li>
 303
 304
 305
 306
 307       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/salira/">Salira (79)</a>
 308
 309
 310       </li>
 311
 312
 313
 314
 315       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/tellabs/">Tellabs (2)</a>
 316
 317
 318       </li>
 319
 320
 321
 322
 323       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/texas-instruments/">Texas Instruments (31)</a>
 324
 325
 326       </li>
 327
 328     </ul>
 329
 330
 331   </div>
 332 </nav>
 333
 334
 335 <nav class="widget-archive-dropdown widget">
 336   <h3 class="widget-header">Archives</h3>
 337   <div class="widget-content">
 338     <select>
 339       <option>Select a Month...</option>
 340
 341       <option value="http://defaria.com/blogs/Status/2016/02/">February 2016</option>
 342
 343
 344
 345       <option value="http://defaria.com/blogs/Status/2014/09/">September 2014</option>
 346
 347
 348
 349       <option value="http://defaria.com/blogs/Status/2014/04/">April 2014</option>
 350
 351
 352
 353       <option value="http://defaria.com/blogs/Status/2014/03/">March 2014</option>
 354
 355
 356
 357       <option value="http://defaria.com/blogs/Status/2013/02/">February 2013</option>
 358
 359
 360
 361       <option value="http://defaria.com/blogs/Status/2012/09/">September 2012</option>
 362
 363
 364
 365       <option value="http://defaria.com/blogs/Status/2012/08/">August 2012</option>
 366
 367
 368
 369       <option value="http://defaria.com/blogs/Status/2012/05/">May 2012</option>
 370
 371
 372
 373       <option value="http://defaria.com/blogs/Status/2012/04/">April 2012</option>
 374
 375
 376
 377       <option value="http://defaria.com/blogs/Status/2012/02/">February 2012</option>
 378
 379
 380
 381       <option value="http://defaria.com/blogs/Status/2012/01/">January 2012</option>
 382
 383
 384
 385       <option value="http://defaria.com/blogs/Status/2011/10/">October 2011</option>
 386
 387
 388
 389       <option value="http://defaria.com/blogs/Status/2011/07/">July 2011</option>
 390
 391
 392
 393       <option value="http://defaria.com/blogs/Status/2010/09/">September 2010</option>
 394
 395
 396
 397       <option value="http://defaria.com/blogs/Status/2010/08/">August 2010</option>
 398
 399
 400
 401       <option value="http://defaria.com/blogs/Status/2010/04/">April 2010</option>
 402
 403
 404
 405       <option value="http://defaria.com/blogs/Status/2010/03/">March 2010</option>
 406
 407
 408
 409       <option value="http://defaria.com/blogs/Status/2010/02/">February 2010</option>
 410
 411
 412
 413       <option value="http://defaria.com/blogs/Status/2009/05/">May 2009</option>
 414
 415
 416
 417       <option value="http://defaria.com/blogs/Status/2009/04/">April 2009</option>
 418
 419
 420
 421       <option value="http://defaria.com/blogs/Status/2008/07/">July 2008</option>
 422
 423
 424
 425       <option value="http://defaria.com/blogs/Status/2008/05/">May 2008</option>
 426
 427
 428
 429       <option value="http://defaria.com/blogs/Status/2008/04/">April 2008</option>
 430
 431
 432
 433       <option value="http://defaria.com/blogs/Status/2008/03/">March 2008</option>
 434
 435
 436
 437       <option value="http://defaria.com/blogs/Status/2008/02/">February 2008</option>
 438
 439
 440
 441       <option value="http://defaria.com/blogs/Status/2008/01/">January 2008</option>
 442
 443
 444
 445       <option value="http://defaria.com/blogs/Status/2007/12/">December 2007</option>
 446
 447
 448
 449       <option value="http://defaria.com/blogs/Status/2007/11/">November 2007</option>
 450
 451
 452
 453       <option value="http://defaria.com/blogs/Status/2007/10/">October 2007</option>
 454
 455
 456
 457       <option value="http://defaria.com/blogs/Status/2007/09/">September 2007</option>
 458
 459
 460
 461       <option value="http://defaria.com/blogs/Status/2007/08/">August 2007</option>
 462
 463
 464
 465       <option value="http://defaria.com/blogs/Status/2007/07/">July 2007</option>
 466
 467
 468
 469       <option value="http://defaria.com/blogs/Status/2007/06/">June 2007</option>
 470
 471
 472
 473       <option value="http://defaria.com/blogs/Status/2007/05/">May 2007</option>
 474
 475
 476
 477       <option value="http://defaria.com/blogs/Status/2007/04/">April 2007</option>
 478
 479
 480
 481       <option value="http://defaria.com/blogs/Status/2007/03/">March 2007</option>
 482
 483
 484
 485       <option value="http://defaria.com/blogs/Status/2007/01/">January 2007</option>
 486
 487
 488
 489       <option value="http://defaria.com/blogs/Status/2006/12/">December 2006</option>
 490
 491
 492
 493       <option value="http://defaria.com/blogs/Status/2006/11/">November 2006</option>
 494
 495
 496
 497       <option value="http://defaria.com/blogs/Status/2006/10/">October 2006</option>
 498
 499
 500
 501       <option value="http://defaria.com/blogs/Status/2006/09/">September 2006</option>
 502
 503
 504
 505       <option value="http://defaria.com/blogs/Status/2006/07/">July 2006</option>
 506
 507
 508
 509       <option value="http://defaria.com/blogs/Status/2006/06/">June 2006</option>
 510
 511
 512
 513       <option value="http://defaria.com/blogs/Status/2006/05/">May 2006</option>
 514
 515
 516
 517       <option value="http://defaria.com/blogs/Status/2006/04/">April 2006</option>
 518
 519
 520
 521       <option value="http://defaria.com/blogs/Status/2006/03/">March 2006</option>
 522
 523
 524
 525       <option value="http://defaria.com/blogs/Status/2006/02/">February 2006</option>
 526
 527
 528
 529       <option value="http://defaria.com/blogs/Status/2006/01/">January 2006</option>
 530
 531
 532
 533       <option value="http://defaria.com/blogs/Status/2005/12/">December 2005</option>
 534
 535
 536
 537       <option value="http://defaria.com/blogs/Status/2005/11/">November 2005</option>
 538
 539
 540
 541       <option value="http://defaria.com/blogs/Status/2005/10/">October 2005</option>
 542
 543
 544
 545       <option value="http://defaria.com/blogs/Status/2005/09/">September 2005</option>
 546
 547
 548
 549       <option value="http://defaria.com/blogs/Status/2005/08/">August 2005</option>
 550
 551
 552
 553       <option value="http://defaria.com/blogs/Status/2005/07/">July 2005</option>
 554
 555
 556
 557       <option value="http://defaria.com/blogs/Status/2005/06/">June 2005</option>
 558
 559
 560
 561       <option value="http://defaria.com/blogs/Status/2005/05/">May 2005</option>
 562
 563
 564
 565       <option value="http://defaria.com/blogs/Status/2005/04/">April 2005</option>
 566
 567
 568
 569       <option value="http://defaria.com/blogs/Status/2005/03/">March 2005</option>
 570
 571
 572
 573       <option value="http://defaria.com/blogs/Status/2005/02/">February 2005</option>
 574
 575
 576
 577       <option value="http://defaria.com/blogs/Status/2005/01/">January 2005</option>
 578
 579
 580
 581       <option value="http://defaria.com/blogs/Status/2004/12/">December 2004</option>
 582
 583
 584
 585       <option value="http://defaria.com/blogs/Status/2004/09/">September 2004</option>
 586
 587
 588
 589       <option value="http://defaria.com/blogs/Status/2004/08/">August 2004</option>
 590
 591
 592
 593       <option value="http://defaria.com/blogs/Status/2004/07/">July 2004</option>
 594
 595
 596
 597       <option value="http://defaria.com/blogs/Status/2004/06/">June 2004</option>
 598
 599
 600
 601       <option value="http://defaria.com/blogs/Status/2004/05/">May 2004</option>
 602
 603
 604
 605       <option value="http://defaria.com/blogs/Status/2004/04/">April 2004</option>
 606
 607
 608
 609       <option value="http://defaria.com/blogs/Status/2004/03/">March 2004</option>
 610
 611
 612
 613       <option value="http://defaria.com/blogs/Status/2004/02/">February 2004</option>
 614
 615
 616
 617       <option value="http://defaria.com/blogs/Status/2004/01/">January 2004</option>
 618
 619
 620
 621       <option value="http://defaria.com/blogs/Status/2003/12/">December 2003</option>
 622
 623
 624
 625       <option value="http://defaria.com/blogs/Status/2003/11/">November 2003</option>
 626
 627     </select>
 628   </div>
 629 </nav>
 630
 631
 632
 633 <div class="widget-syndication widget section">
 634   <div class="widget-content">
 635     <p><img src="http://defaria.com/mt/mt-static/images/status_icons/feed.gif" alt="Subscribe to feed" width="9" height="9" /> <a href="http://defaria.com/blogs/Status/atom.xml">Subscribe to this blog's feed</a></p>
 636
 637   </div>
 638 </div>
 639
 640             </aside>
 641           </div>
 642         </div>
 643         <footer id="footer" role="contentinfo">
 644           <div id="footer-inner">
 645             <div id="footer-content">
 646   <nav role="navigation">
 647           <ul>
 648             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
 649
 650
 651           </ul>
 652         </nav>
 653
 654   <p class="license">&copy; Copyright 2016.</p>
 655   <p class="poweredby">Powered by <a href="http://www.movabletype.org/">Movable Type</a></p>
 656 </div>
 657           </div>
 658         </footer>
 659       </div>
 660     </div>
 661     <script src="http://defaria.com/mt/mt-static/jquery/jquery.min.js"></script>
 662     <script src="http://defaria.com/blogs/Status/mt-theme-scale2.js"></script>
 663   </body>
 664 </html>