defaria.com/blogs/Status/archives/000205.html

   1 <!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Transitional//EN"
   2    "http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd">
   3 <html xmlns="http://www.w3.org/1999/xhtml" id="sixapart-standard">
   4 <head>
   5    <meta http-equiv="Content-Type" content="text/html; charset=utf-8" />
   6    <meta name="generator" content="Movable Type 5.2.3" />
   7
   8    <link rel="stylesheet" href="http://defaria.com/blogs/Status/styles-site.css" type="text/css" />
   9    <link rel="alternate" type="application/atom+xml" title="Atom" href="http://defaria.com/blogs/Status/atom.xml" />
  10    <link rel="alternate" type="application/rss+xml" title="RSS 2.0" href="http://defaria.com/blogs/Status/index.xml" />
  11
  12    <title>Status for Andrew DeFaria: Finished backup script</title>
  13
  14    <link rel="start" href="http://defaria.com/blogs/Status/" title="Home" />
  15    <link rel="prev" href="http://defaria.com/blogs/Status/archives/000202.html" title="Multisite/backup.pl" />
  16    <link rel="next" href="http://defaria.com/blogs/Status/archives/000206.html" title="BUCS Build Measurements" />
  17
  18
  19
  20
  21
  22    <script type="text/javascript" src="http://defaria.com/blogs/Status/mt-site.js"></script>
  23 </head>
  24 <body class="layout-one-column" onload="individualArchivesOnLoad(commenter_name)">
  25    <div id="container">
  26       <div id="container-inner" class="pkg">
  27
  28          <div id="banner">
  29             <div id="banner-inner" class="pkg">
  30                <h1 id="banner-header"><a href="http://defaria.com/blogs/Status/" accesskey="1">Status for Andrew DeFaria</a></h1>
  31                <h2 id="banner-description">Searchable status reports and work log</h2>
  32             </div>
  33          </div>
  34
  35          <div id="pagebody">
  36             <div id="pagebody-inner" class="pkg">
  37                <div id="alpha">
  38                   <div id="alpha-inner" class="pkg">
  39
  40                      <p class="content-nav">
  41                         <a href="http://defaria.com/blogs/Status/archives/000202.html">&laquo; Multisite/backup.pl</a> |
  42                         <a href="http://defaria.com/blogs/Status/">Main</a>
  43                         | <a href="http://defaria.com/blogs/Status/archives/000206.html">BUCS Build Measurements &raquo;</a>
  44                      </p>
  45
  46                      <a id="a000205"></a>
  47                      <div class="entry" id="entry-205">
  48                         <h3 class="entry-header">Finished backup script</h3>
  49                         <div class="entry-content">
  50                            <div class="entry-body">
  51                               <p>The backup script is ready for deployment. It was determined to lock all vobs at once, back them all up then unlock the vobs. I also implemented the 7 days of history option. History is stored under d:\vobstore\backup as numbered directories (0-6 for Sun-Sat). The script now manages that area by first moving the current backup under d:\backup -> d:\vobstore\backup\<current day #> after first clearing out d:\vobstore\backup\<current day #> (if it existed). It was decided to put the history stuff under vobstore because this way we can tell the backup people "Just exclude d:\vobstore but get everything else".</p>
  52
  53 <p>I was experiencing "Access denied" errors irradically until I found out that there may be .being-deleted files as described <a href="http://www-1.ibm.com/support/docview.wss?rs=0&q1=being-deleted&uid=swg21129318&loc=en_US&cs=utf-8&cc=us&lang=en">here</a>. To solve this I implemented exclusions on the xcopy command (/exclude:d:\backup\exclude.strings) which tells xcopy to exclude things in the "c" directory - i.e. the cleartext pool - which Clearcase can easily recreate without data loss. This also has the effect of reducing the backup copy size in some cases significantly (e.g. \ASAP_Docs goes from 2.1 gig down to 1 gig!).</p>
  54
  55 <p>Here's a rough psuedo code of what the script does:</p>
  56
  57 <div id="code">
  58 <pre>
  59 Obtain a list of all vobs
  60 Lock all vobs
  61 foreach @vobs
  62   if d:\vobstore\backup\$current_day\$vob exists then
  63     remove it
  64   end if
  65   move d:\backup\$vob -> d:\vobstore\backup\$current_day\$vob
  66   copy $vob's storage area -> d:\backup\$vob
  67 Next
  68 Unlock all vobs
  69 </pre>
  70 </div>
  71 <p>Cutting out the copying of cleartext pool has reduced the current backup time from 56 minutes (yes it grew) to 33 minutes.</p>
  72
  73 <p>Now, where are we WRT the SQL backup scripts?....</p>
  74                            </div>
  75                            <div id="more" class="entry-more">
  76
  77                            </div>
  78                         </div>
  79                         <p class="entry-footer">
  80                            <span class="post-footers">Posted by  on June 25, 2004  3:37 PM</span> <span class="separator">|</span> <a class="permalink" href="http://defaria.com/blogs/Status/archives/000205.html">Permalink</a>
  81                         </p>
  82                      </div>
  83
  84
  85
  86
  87                   </div>
  88                </div>
  89             </div>
  90          </div>
  91       </div>
  92    </div>
  93 </body>
  94 </html>