defaria.com/blogs/Status/2004/06/finished-backup.html

   1 <!DOCTYPE html>
   2 <html lang="en-us" itemscope itemtype="http://schema.org/Article">
   3   <head>
   4     <meta charset="utf-8">
   5     <meta name="description" content="The backup script is ready for deployment. It was determined to lock all vobs at once, back them all up then unlock the vobs. I also implemented the 7 days of history option. History is stored under d:\vobstore\backup as numbered...">
   6     <meta name="generator" content="Movable Type 5.2.3">
   7     <title>Finished backup script - Status</title>
   8     <link rel="alternate" type="application/atom+xml" title="Recent Entries" href="http://defaria.com/blogs/Status/atom.xml">
   9     <link rel="canonical" href="http://defaria.com/blogs/Status/2004/06/finished-backup.html">
  10     <meta name="viewport" content="width=device-width,initial-scale=1">
  11     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles.css">
  12     <!--[if lt IE 9]>
  13     <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles_ie.css">
  14     <script src="/mt/mt-static/support/theme_static/rainier/js/html5shiv.js"></script>
  15     <![endif]-->
  16
  17     <link rel="start" href="http://defaria.com/blogs/Status/">
  18
  19     <link rel="prev" href="http://defaria.com/blogs/Status/2004/06/multisitebackup.html" title="Multisite/backup.pl">
  20     <link rel="next" href="http://defaria.com/blogs/Status/2004/07/bucs-build-meas.html" title="BUCS Build Measurements">
  21     <!-- Open Graph Protocol -->
  22     <meta property="og:type" content="article">
  23     <meta property="og:locale" content="en-us">
  24     <meta property="og:title" content="Finished backup script">
  25     <meta property="og:url" content="http://defaria.com/blogs/Status/2004/06/finished-backup.html">
  26     <meta property="og:description" content="The backup script is ready for deployment. It was determined to lock all vobs at once, back them all up then unlock the vobs. I also implemented the 7 days of history option. History is stored under d:\vobstore\backup as numbered...">
  27     <meta property="og:site_name" content="Status">
  28     <meta property="og:image" content="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  29     <!-- Metadata -->
  30     <meta itemprop="description" content="The backup script is ready for deployment. It was determined to lock all vobs at once, back them all up then unlock the vobs. I also implemented the 7 days of history option. History is stored under d:\vobstore\backup as numbered...">
  31     <link itemprop="url" href="http://defaria.com/blogs/Status/2004/06/finished-backup.html">
  32     <link itemprop="image" href="/mt/mt-static/support/theme_static/rainier/img/siteicon-sample.png">
  33
  34   </head>
  35   <body>
  36     <div id="container">
  37       <div id="container-inner">
  38         <header id="header" role="banner">
  39           <div id="header-inner">
  40             <div id="header-content">
  41               <h1>
  42                 <a href="http://defaria.com/blogs/Status/">
  43
  44                   Status
  45
  46                 </a>
  47               </h1>
  48
  49             </div>
  50
  51             <nav role="navigation">
  52           <ul>
  53             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
  54
  55
  56           </ul>
  57         </nav>
  58
  59           </div>
  60         </header>
  61         <div id="content">
  62           <div id="content-inner">
  63             <ul class="breadcrumb breadcrumb-list">
  64               <li class="breadcrumb-list-item"><a href="http://defaria.com/blogs/Status/">Home</a></li>
  65               <li class="breadcrumb-list-item">Finished backup script</li>
  66             </ul>
  67             <div id="individual-main" class="main" role="main">
  68               <article id="entry-1480" class="entry entry-asset asset hentry">
  69                 <div class="asset-header">
  70                   <h2 itemprop="name" class="asset-name entry-title">Finished backup script</h2>
  71                   <footer class="asset-meta">
  72                     <ul class="asset-meta-list">
  73                       <li class="asset-meta-list-item">Posted on <time datetime="2004-06-25T15:37:42-08:00" itemprop="datePublished">June 25, 2004</time></li>
  74                       <li class="asset-meta-list-item">by <span class="author entry-author vcard"></span></li>
  75
  76
  77                       <li class="asset-meta-list-item">in <a itemprop="articleSection" rel="tag" href="http://defaria.com/blogs/Status/ameriquest/">Ameriquest</a></li>
  78
  79
  80                    </ul>
  81                 </footer>
  82                 </div>
  83                 <div class="entry-content asset-content" itemprop="articleBody">
  84                   <p>The backup script is ready for deployment. It was determined to lock all vobs at once, back them all up then unlock the vobs. I also implemented the 7 days of history option. History is stored under d:\vobstore\backup as numbered directories (0-6 for Sun-Sat). The script now manages that area by first moving the current backup under d:\backup -> d:\vobstore\backup\<current day #> after first clearing out d:\vobstore\backup\<current day #> (if it existed). It was decided to put the history stuff under vobstore because this way we can tell the backup people "Just exclude d:\vobstore but get everything else".</p>
  85
  86 <p>I was experiencing "Access denied" errors irradically until I found out that there may be .being-deleted files as described <a href="http://www-1.ibm.com/support/docview.wss?rs=0&q1=being-deleted&uid=swg21129318&loc=en_US&cs=utf-8&cc=us&lang=en">here</a>. To solve this I implemented exclusions on the xcopy command (/exclude:d:\backup\exclude.strings) which tells xcopy to exclude things in the "c" directory - i.e. the cleartext pool - which Clearcase can easily recreate without data loss. This also has the effect of reducing the backup copy size in some cases significantly (e.g. \ASAP_Docs goes from 2.1 gig down to 1 gig!).</p>
  87
  88 <p>Here's a rough psuedo code of what the script does:</p>
  89
  90 <div id="code">
  91 <pre>
  92 Obtain a list of all vobs
  93 Lock all vobs
  94 foreach @vobs
  95   if d:\vobstore\backup\$current_day\$vob exists then
  96     remove it
  97   end if
  98   move d:\backup\$vob -> d:\vobstore\backup\$current_day\$vob
  99   copy $vob's storage area -> d:\backup\$vob
 100 Next
 101 Unlock all vobs
 102 </pre>
 103 </div>
 104 <p>Cutting out the copying of cleartext pool has reduced the current backup time from 56 minutes (yes it grew) to 33 minutes.</p>
 105
 106 <p>Now, where are we WRT the SQL backup scripts?....</p>
 107
 108                 </div>
 109                 <nav class="page-navigation entry-navigation pagination content-nav">
 110                   <ul class="page-navigation-list">
 111
 112                     <li class="page-navigation-list-item page-navigation-prev"><a rel="prev" href="http://defaria.com/blogs/Status/2004/06/multisitebackup.html" title="Multisite/backup.pl">Previous entry</a></li>
 113
 114
 115                     <li class="page-navigation-list-item page-navigation-next"><a rel="next" href="http://defaria.com/blogs/Status/2004/07/bucs-build-meas.html" title="BUCS Build Measurements">Next entry</a></li>
 116
 117                   </ul>
 118                 </nav>
 119                 <!--
 120 <aside id="zenback" class="zenback feedback">
 121   Please paste Zenback script code here.
 122 </aside>
 123 -->
 124
 125
 126               </article>
 127             </div>
 128             <aside class="widgets related" role="complementary">
 129               <nav class="widget-search widget">
 130   <div class="widget-content">
 131     <form method="get" id="search" action="http://defaria.com/mt/mt-search.cgi">
 132       <div>
 133         <input type="text" name="search" value="" placeholder="Search...">
 134
 135         <input type="hidden" name="IncludeBlogs" value="8">
 136
 137         <input type="hidden" name="limit" value="20">
 138         <button type="submit" name="button">
 139           <img alt="Search" src="/mt/mt-static/support/theme_static/rainier/img/search-icon.png">
 140         </button>
 141       </div>
 142     </form>
 143   </div>
 144 </nav>
 145 <nav class="widget-archive-category widget">
 146   <h3 class="widget-header">Categories</h3>
 147   <div class="widget-content">
 148
 149
 150     <ul class="widget-list">
 151
 152
 153       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/ameriquest/">Ameriquest (99)</a>
 154
 155
 156       </li>
 157
 158
 159
 160
 161       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/audience/">Audience (3)</a>
 162
 163
 164       </li>
 165
 166
 167
 168
 169       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/broadcom/">Broadcom (76)</a>
 170
 171
 172       </li>
 173
 174
 175
 176
 177       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/gpdb/">GPDB (35)</a>
 178
 179
 180       </li>
 181
 182
 183
 184
 185       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-dynamics/">General Dynamics (61)</a>
 186
 187
 188       </li>
 189
 190
 191
 192
 193       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/general-electric/">General Electric (13)</a>
 194
 195
 196       </li>
 197
 198
 199
 200
 201       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/hewlett-packard/">Hewlett Packard (13)</a>
 202
 203
 204       </li>
 205
 206
 207
 208
 209       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/lynuxworks/">LynuxWorks (162)</a>
 210
 211
 212       </li>
 213
 214
 215
 216
 217       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/pqa/">PQA (35)</a>
 218
 219
 220       </li>
 221
 222
 223
 224
 225       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/salira/">Salira (79)</a>
 226
 227
 228       </li>
 229
 230
 231
 232
 233       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/tellabs/">Tellabs (2)</a>
 234
 235
 236       </li>
 237
 238
 239
 240
 241       <li class="widget-list-item"><a href="http://defaria.com/blogs/Status/texas-instruments/">Texas Instruments (31)</a>
 242
 243
 244       </li>
 245
 246     </ul>
 247
 248
 249   </div>
 250 </nav>
 251
 252
 253 <nav class="widget-archive-dropdown widget">
 254   <h3 class="widget-header">Archives</h3>
 255   <div class="widget-content">
 256     <select>
 257       <option>Select a Month...</option>
 258
 259       <option value="http://defaria.com/blogs/Status/2016/02/">February 2016</option>
 260
 261
 262
 263       <option value="http://defaria.com/blogs/Status/2014/09/">September 2014</option>
 264
 265
 266
 267       <option value="http://defaria.com/blogs/Status/2014/04/">April 2014</option>
 268
 269
 270
 271       <option value="http://defaria.com/blogs/Status/2014/03/">March 2014</option>
 272
 273
 274
 275       <option value="http://defaria.com/blogs/Status/2013/02/">February 2013</option>
 276
 277
 278
 279       <option value="http://defaria.com/blogs/Status/2012/09/">September 2012</option>
 280
 281
 282
 283       <option value="http://defaria.com/blogs/Status/2012/08/">August 2012</option>
 284
 285
 286
 287       <option value="http://defaria.com/blogs/Status/2012/05/">May 2012</option>
 288
 289
 290
 291       <option value="http://defaria.com/blogs/Status/2012/04/">April 2012</option>
 292
 293
 294
 295       <option value="http://defaria.com/blogs/Status/2012/02/">February 2012</option>
 296
 297
 298
 299       <option value="http://defaria.com/blogs/Status/2012/01/">January 2012</option>
 300
 301
 302
 303       <option value="http://defaria.com/blogs/Status/2011/10/">October 2011</option>
 304
 305
 306
 307       <option value="http://defaria.com/blogs/Status/2011/07/">July 2011</option>
 308
 309
 310
 311       <option value="http://defaria.com/blogs/Status/2010/09/">September 2010</option>
 312
 313
 314
 315       <option value="http://defaria.com/blogs/Status/2010/08/">August 2010</option>
 316
 317
 318
 319       <option value="http://defaria.com/blogs/Status/2010/04/">April 2010</option>
 320
 321
 322
 323       <option value="http://defaria.com/blogs/Status/2010/03/">March 2010</option>
 324
 325
 326
 327       <option value="http://defaria.com/blogs/Status/2010/02/">February 2010</option>
 328
 329
 330
 331       <option value="http://defaria.com/blogs/Status/2009/05/">May 2009</option>
 332
 333
 334
 335       <option value="http://defaria.com/blogs/Status/2009/04/">April 2009</option>
 336
 337
 338
 339       <option value="http://defaria.com/blogs/Status/2008/07/">July 2008</option>
 340
 341
 342
 343       <option value="http://defaria.com/blogs/Status/2008/05/">May 2008</option>
 344
 345
 346
 347       <option value="http://defaria.com/blogs/Status/2008/04/">April 2008</option>
 348
 349
 350
 351       <option value="http://defaria.com/blogs/Status/2008/03/">March 2008</option>
 352
 353
 354
 355       <option value="http://defaria.com/blogs/Status/2008/02/">February 2008</option>
 356
 357
 358
 359       <option value="http://defaria.com/blogs/Status/2008/01/">January 2008</option>
 360
 361
 362
 363       <option value="http://defaria.com/blogs/Status/2007/12/">December 2007</option>
 364
 365
 366
 367       <option value="http://defaria.com/blogs/Status/2007/11/">November 2007</option>
 368
 369
 370
 371       <option value="http://defaria.com/blogs/Status/2007/10/">October 2007</option>
 372
 373
 374
 375       <option value="http://defaria.com/blogs/Status/2007/09/">September 2007</option>
 376
 377
 378
 379       <option value="http://defaria.com/blogs/Status/2007/08/">August 2007</option>
 380
 381
 382
 383       <option value="http://defaria.com/blogs/Status/2007/07/">July 2007</option>
 384
 385
 386
 387       <option value="http://defaria.com/blogs/Status/2007/06/">June 2007</option>
 388
 389
 390
 391       <option value="http://defaria.com/blogs/Status/2007/05/">May 2007</option>
 392
 393
 394
 395       <option value="http://defaria.com/blogs/Status/2007/04/">April 2007</option>
 396
 397
 398
 399       <option value="http://defaria.com/blogs/Status/2007/03/">March 2007</option>
 400
 401
 402
 403       <option value="http://defaria.com/blogs/Status/2007/01/">January 2007</option>
 404
 405
 406
 407       <option value="http://defaria.com/blogs/Status/2006/12/">December 2006</option>
 408
 409
 410
 411       <option value="http://defaria.com/blogs/Status/2006/11/">November 2006</option>
 412
 413
 414
 415       <option value="http://defaria.com/blogs/Status/2006/10/">October 2006</option>
 416
 417
 418
 419       <option value="http://defaria.com/blogs/Status/2006/09/">September 2006</option>
 420
 421
 422
 423       <option value="http://defaria.com/blogs/Status/2006/07/">July 2006</option>
 424
 425
 426
 427       <option value="http://defaria.com/blogs/Status/2006/06/">June 2006</option>
 428
 429
 430
 431       <option value="http://defaria.com/blogs/Status/2006/05/">May 2006</option>
 432
 433
 434
 435       <option value="http://defaria.com/blogs/Status/2006/04/">April 2006</option>
 436
 437
 438
 439       <option value="http://defaria.com/blogs/Status/2006/03/">March 2006</option>
 440
 441
 442
 443       <option value="http://defaria.com/blogs/Status/2006/02/">February 2006</option>
 444
 445
 446
 447       <option value="http://defaria.com/blogs/Status/2006/01/">January 2006</option>
 448
 449
 450
 451       <option value="http://defaria.com/blogs/Status/2005/12/">December 2005</option>
 452
 453
 454
 455       <option value="http://defaria.com/blogs/Status/2005/11/">November 2005</option>
 456
 457
 458
 459       <option value="http://defaria.com/blogs/Status/2005/10/">October 2005</option>
 460
 461
 462
 463       <option value="http://defaria.com/blogs/Status/2005/09/">September 2005</option>
 464
 465
 466
 467       <option value="http://defaria.com/blogs/Status/2005/08/">August 2005</option>
 468
 469
 470
 471       <option value="http://defaria.com/blogs/Status/2005/07/">July 2005</option>
 472
 473
 474
 475       <option value="http://defaria.com/blogs/Status/2005/06/">June 2005</option>
 476
 477
 478
 479       <option value="http://defaria.com/blogs/Status/2005/05/">May 2005</option>
 480
 481
 482
 483       <option value="http://defaria.com/blogs/Status/2005/04/">April 2005</option>
 484
 485
 486
 487       <option value="http://defaria.com/blogs/Status/2005/03/">March 2005</option>
 488
 489
 490
 491       <option value="http://defaria.com/blogs/Status/2005/02/">February 2005</option>
 492
 493
 494
 495       <option value="http://defaria.com/blogs/Status/2005/01/">January 2005</option>
 496
 497
 498
 499       <option value="http://defaria.com/blogs/Status/2004/12/">December 2004</option>
 500
 501
 502
 503       <option value="http://defaria.com/blogs/Status/2004/09/">September 2004</option>
 504
 505
 506
 507       <option value="http://defaria.com/blogs/Status/2004/08/">August 2004</option>
 508
 509
 510
 511       <option value="http://defaria.com/blogs/Status/2004/07/">July 2004</option>
 512
 513
 514
 515       <option value="http://defaria.com/blogs/Status/2004/06/">June 2004</option>
 516
 517
 518
 519       <option value="http://defaria.com/blogs/Status/2004/05/">May 2004</option>
 520
 521
 522
 523       <option value="http://defaria.com/blogs/Status/2004/04/">April 2004</option>
 524
 525
 526
 527       <option value="http://defaria.com/blogs/Status/2004/03/">March 2004</option>
 528
 529
 530
 531       <option value="http://defaria.com/blogs/Status/2004/02/">February 2004</option>
 532
 533
 534
 535       <option value="http://defaria.com/blogs/Status/2004/01/">January 2004</option>
 536
 537
 538
 539       <option value="http://defaria.com/blogs/Status/2003/12/">December 2003</option>
 540
 541
 542
 543       <option value="http://defaria.com/blogs/Status/2003/11/">November 2003</option>
 544
 545     </select>
 546   </div>
 547 </nav>
 548
 549
 550
 551 <div class="widget-syndication widget section">
 552   <div class="widget-content">
 553     <p><img src="http://defaria.com/mt/mt-static/images/status_icons/feed.gif" alt="Subscribe to feed" width="9" height="9" /> <a href="http://defaria.com/blogs/Status/atom.xml">Subscribe to this blog's feed</a></p>
 554
 555   </div>
 556 </div>
 557
 558             </aside>
 559           </div>
 560         </div>
 561         <footer id="footer" role="contentinfo">
 562           <div id="footer-inner">
 563             <div id="footer-content">
 564   <nav role="navigation">
 565           <ul>
 566             <li><a href="http://defaria.com/blogs/Status/">Home</a></li>
 567
 568
 569           </ul>
 570         </nav>
 571
 572   <p class="license">&copy; Copyright 2016.</p>
 573   <p class="poweredby">Powered by <a href="http://www.movabletype.org/">Movable Type</a></p>
 574 </div>
 575           </div>
 576         </footer>
 577       </div>
 578     </div>
 579     <script src="http://defaria.com/mt/mt-static/jquery/jquery.min.js"></script>
 580     <script src="http://defaria.com/blogs/Status/mt-theme-scale2.js"></script>
 581   </body>
 582 </html>