clearscm.git
2 years agoChanged to log subject
Andrew DeFaria [Wed, 9 Mar 2022 18:06:20 +0000 (10:06 -0800)]
Changed to log subject

2 years agoMisc changes
Andrew DeFaria [Sat, 5 Mar 2022 19:57:37 +0000 (11:57 -0800)]
Misc changes

2 years agoRemoved execute from cPanel
Andrew DeFaria [Thu, 17 Feb 2022 21:35:25 +0000 (13:35 -0800)]
Removed execute from cPanel

2 years agoEarily work on converting speech to Perl
Andrew DeFaria [Tue, 15 Feb 2022 17:25:31 +0000 (09:25 -0800)]
Earily work on converting speech to Perl

2 years agoRemvoed nightly and fixed ForwardX11
Andrew DeFaria [Tue, 15 Feb 2022 17:21:48 +0000 (09:21 -0800)]
Remvoed nightly and fixed ForwardX11

2 years agoQuoted double quotes
Andrew DeFaria [Tue, 15 Feb 2022 17:20:58 +0000 (09:20 -0800)]
Quoted double quotes

2 years agoChanged to handle cpanel client script
Andrew DeFaria [Mon, 14 Feb 2022 20:12:44 +0000 (20:12 +0000)]
Changed to handle cpanel client script

2 years agoUpdated ~/.ssh/config
Andrew DeFaria [Mon, 14 Feb 2022 19:55:46 +0000 (19:55 +0000)]
Updated ~/.ssh/config

2 years agoMore updates for cPanel
Andrew DeFaria [Thu, 10 Feb 2022 21:47:58 +0000 (21:47 +0000)]
More updates for cPanel

2 years agoAdded scripts to capture screen or area and save the file under a dated file name...
Andrew DeFaria [Fri, 4 Feb 2022 20:12:38 +0000 (12:12 -0800)]
Added scripts to capture screen or area and save the file under a dated file name in /System/tmp

2 years agoChanges to speak and check4update
Andrew DeFaria [Fri, 4 Feb 2022 20:11:32 +0000 (12:11 -0800)]
Changes to speak and check4update

. Changed Speak.pm to log things and to not try to avoid two speakers
speaking at once.
. Change shh to find and kill any processes currently speaking
.Changed speak to sanitist input beforespeaking.

2 years agoEven more changes
Andrew DeFaria [Wed, 19 Jan 2022 17:48:49 +0000 (09:48 -0800)]
Even more changes

2 years agoMore updates for cleantmp.conf
Andrew DeFaria [Wed, 19 Jan 2022 17:47:18 +0000 (09:47 -0800)]
More updates for cleantmp.conf

2 years agoAdded ulw
Andrew DeFaria [Fri, 14 Jan 2022 19:51:48 +0000 (19:51 +0000)]
Added ulw

2 years agoAdded debug logging to certbot scripts
Andrew DeFaria [Fri, 7 Jan 2022 18:21:41 +0000 (10:21 -0800)]
Added debug logging to certbot scripts

2 years agoAliased perl
Andrew DeFaria [Fri, 7 Jan 2022 18:20:04 +0000 (18:20 +0000)]
Aliased perl

2 years agoThis is the announceEmail.pl that works
Andrew DeFaria [Fri, 7 Jan 2022 18:17:02 +0000 (10:17 -0800)]
This is the announceEmail.pl that works

2 years agoFixed shh to use different location for shh touchfile
Andrew DeFaria [Wed, 5 Jan 2022 20:05:44 +0000 (12:05 -0800)]
Fixed shh to use different location for shh touchfile

Otherwise the script removes itself!

2 years agoMoved scripts from /System/bin to /opt/clearscm/bin
Andrew DeFaria [Wed, 5 Jan 2022 18:34:32 +0000 (10:34 -0800)]
Moved scripts from /System/bin to /opt/clearscm/bin

Then symlinked them back to /System/bin. This puts these scripts under version control

2 years agoFixed bug with aliasing less when not installed
Andrew DeFaria [Tue, 4 Jan 2022 21:34:54 +0000 (13:34 -0800)]
Fixed bug with aliasing less when not installed

2 years agoMore changes for cPanel
Andrew DeFaria [Fri, 17 Dec 2021 21:46:48 +0000 (21:46 +0000)]
More changes for cPanel

2 years agoMore cPanel specific changes
Andrew DeFaria [Tue, 14 Dec 2021 17:42:06 +0000 (17:42 +0000)]
More cPanel specific changes

2 years agoAdded setting of EDITOR
Andrew DeFaria [Tue, 14 Dec 2021 17:40:27 +0000 (09:40 -0800)]
Added setting of EDITOR

2 years agoAdded sshconfig and vimrc
Andrew DeFaria [Thu, 9 Dec 2021 18:34:28 +0000 (10:34 -0800)]
Added sshconfig and vimrc

2 years agoWhy did gitignore empty?
Andrew DeFaria [Thu, 9 Dec 2021 18:28:15 +0000 (10:28 -0800)]
Why did gitignore empty?

2 years agoSmall changes to system and cPanel
Andrew DeFaria [Tue, 7 Dec 2021 16:49:23 +0000 (16:49 +0000)]
Small changes to system and cPanel

2 years agoAdded cPanel "client_scripts"
Andrew DeFaria [Mon, 15 Nov 2021 16:08:40 +0000 (08:08 -0800)]
Added cPanel "client_scripts"

2 years agoMerge pull request #1 from adefaria/DEV
Andrew DeFaria [Fri, 12 Nov 2021 15:55:55 +0000 (07:55 -0800)]
Merge pull request #1 from adefaria/DEV

Added better error checking on MAPSDeliver

2 years agoVarious updates from DEV
Andrew DeFaria [Fri, 12 Nov 2021 15:50:51 +0000 (07:50 -0800)]
Various updates from DEV

New setlogin for impish
Removed DBUS from cleantmp.conf
Speak has a few improvements on backing off
Removed tabs from gitconfig

2 years agoAdded better error checking on MAPSDeliver
Andrew DeFaria [Thu, 4 Nov 2021 22:19:43 +0000 (15:19 -0700)]
Added better error checking on MAPSDeliver

2 years agoMerged MAPS2.0
Andrew DeFaria [Thu, 4 Nov 2021 22:17:11 +0000 (15:17 -0700)]
Merged MAPS2.0

2 years agoFixed bash_completion for Mac and updated system
Andrew DeFaria [Thu, 4 Nov 2021 19:23:31 +0000 (12:23 -0700)]
Fixed bash_completion for Mac and updated system

2 years agoMinor fixes
Andrew DeFaria [Tue, 12 Oct 2021 11:31:39 +0000 (04:31 -0700)]
Minor fixes

2 years agoRemoved debugging print statement
Andrew DeFaria [Tue, 5 Oct 2021 01:25:17 +0000 (18:25 -0700)]
Removed debugging print statement

2 years agoCurrent version of announceEmail.pl
Andrew DeFaria [Fri, 1 Oct 2021 22:09:02 +0000 (15:09 -0700)]
Current version of announceEmail.pl

2 years agoRewrote ReadMsg - Andrew@ClearSCM.com check
Andrew DeFaria [Mon, 13 Sep 2021 17:16:15 +0000 (10:16 -0700)]
Rewrote ReadMsg - Andrew@ClearSCM.com check

As I've gotten Andrew@ClearSCM.com email working again and it just send
it to Andrew@DeFaria.com I noticed that I was now getting additional
spam messages with a To of Andrew@ClearSCM.com. I rarely, if ever send
email to Andrew@ClearSCM.com and if I start I'll use the old trick of a
checking for full email address of "Andrew DeFaria
<Andrew@ClearSCM.com>" on To (not implemented yet). Meantime I will just
assume all email sent to Andrew@ClearSCM.com is spam.

In order to implement this I needed to change ReadMsg to also return the
To: address. Since the return arguments were getting large I chqanged
this to return a hash.

2 years agoFixed rule
Andrew DeFaria [Sat, 11 Sep 2021 22:45:46 +0000 (15:45 -0700)]
Fixed rule

2 years agoEliminated duplicate "Rule: "
Andrew DeFaria [Wed, 25 Aug 2021 13:20:12 +0000 (06:20 -0700)]
Eliminated duplicate "Rule: "

2 years agoFixed RecordHit to update last_hit
Andrew DeFaria [Wed, 18 Aug 2021 20:52:46 +0000 (13:52 -0700)]
Fixed RecordHit to update last_hit

2 years agoFixed RecordHit
Andrew DeFaria [Wed, 18 Aug 2021 16:55:29 +0000 (09:55 -0700)]
Fixed RecordHit

2 years agoFixed bug in AddLog
Andrew DeFaria [Fri, 13 Aug 2021 12:31:20 +0000 (05:31 -0700)]
Fixed bug in AddLog

2 years agoOops! Forgot to include MAPS.pm
Andrew DeFaria [Thu, 12 Aug 2021 19:48:12 +0000 (12:48 -0700)]
Oops! Forgot to include MAPS.pm

2 years agoMore improvements
Andrew DeFaria [Thu, 12 Aug 2021 19:45:40 +0000 (12:45 -0700)]
More improvements

. Changed checkaddress.cgi to be more informative about other fields
  such as retention and comment.
. Changed maps main script to use full list record so as to allow the
  ability to report individual fields in the list record instead of just
  returning rule
. Changed detail.cgi to use list record instead of just rule
. Changed detail.cgi to handle corner cases where there are 1 less than
  the number of lines to be displayed.
. Added retention to Returned report
. Fixed font size problem with comment
. Made Checkaddress window a little bigger.
. MAPS.pm: Changed the way the ReturnSenders returns senders. A little
  more array manipulation but more accurate. Also made sure email
  addresses are downshifted before adding to log table.

2 years agoFixed menu
Andrew DeFaria [Sun, 8 Aug 2021 19:08:40 +0000 (12:08 -0700)]
Fixed menu

2 years agoUpdated announceEmail.pl
Andrew DeFaria [Sat, 7 Aug 2021 03:20:04 +0000 (20:20 -0700)]
Updated announceEmail.pl

And a few other scripts

2 years agoKilled long standing bug in Returned report
Andrew DeFaria [Thu, 5 Aug 2021 17:48:32 +0000 (10:48 -0700)]
Killed long standing bug in Returned report

Needed to compare >=

2 years agoAdded rule to logging
Andrew DeFaria [Tue, 27 Jul 2021 23:09:47 +0000 (16:09 -0700)]
Added rule to logging

2 years agoFixed but when attempting to nulllist people pretending to be me
Andrew DeFaria [Tue, 27 Jul 2021 20:06:34 +0000 (13:06 -0700)]
Fixed but when attempting to nulllist people pretending to be me

2 years agoMore changes to quickstats.
Andrew DeFaria [Tue, 27 Jul 2021 00:21:14 +0000 (17:21 -0700)]
More changes to quickstats.

2 years agoFixed quickstats
Andrew DeFaria [Fri, 23 Jul 2021 21:56:48 +0000 (14:56 -0700)]
Fixed quickstats

Well not totally fixed. There are still some CSS issues.

2 years agoFixing up numbers and totals
Andrew DeFaria [Thu, 22 Jul 2021 17:37:45 +0000 (10:37 -0700)]
Fixing up numbers and totals

Some areas like quickstats and total needed to use count_distinct so I
created MAPS::CountLogDistinct.

2 years agoMore fixes
Andrew DeFaria [Wed, 21 Jul 2021 05:19:55 +0000 (22:19 -0700)]
More fixes

. Fixed bug in maps where people pretending to me were getting through
. Changed table formatting to be more similar

2 years agoChanged to use Perl 5.026
Andrew DeFaria [Tue, 20 Jul 2021 19:07:26 +0000 (12:07 -0700)]
Changed to use Perl 5.026

2 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 20 Jul 2021 19:05:35 +0000 (12:05 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

2 years agoFixes to raid
Andrew DeFaria [Tue, 20 Jul 2021 19:05:02 +0000 (12:05 -0700)]
Fixes to raid

2 years agoStill tinkering with announceEmail
Andrew DeFaria [Tue, 20 Jul 2021 19:04:34 +0000 (12:04 -0700)]
Still tinkering with announceEmail

2 years agoSome changes to dot files
Andrew DeFaria [Tue, 20 Jul 2021 18:59:53 +0000 (11:59 -0700)]
Some changes to dot files

2 years agoFixed bug where adding a username only rule failed
Andrew DeFaria [Tue, 20 Jul 2021 18:59:01 +0000 (11:59 -0700)]
Fixed bug where adding a username only rule failed

2 years agoRearranged display for reports; fixed search.cgi
Andrew DeFaria [Tue, 20 Jul 2021 18:57:19 +0000 (11:57 -0700)]
Rearranged display for reports; fixed search.cgi

2 years agoFixed bug in search.cgi
Andrew DeFaria [Tue, 20 Jul 2021 13:36:11 +0000 (06:36 -0700)]
Fixed bug in search.cgi

2 years agoChanged CheckonList to append comment to rule if there is a comment
Andrew DeFaria [Mon, 19 Jul 2021 18:14:00 +0000 (11:14 -0700)]
Changed CheckonList to append comment to rule if there is a comment

2 years agoFixed bug with counting messages
Andrew DeFaria [Sun, 18 Jul 2021 04:18:19 +0000 (21:18 -0700)]
Fixed bug with counting messages

2 years agoFixed Resequence list to sort hit_count desc
Andrew DeFaria [Sun, 18 Jul 2021 03:44:16 +0000 (20:44 -0700)]
Fixed Resequence list to sort hit_count desc

2 years agoFixed bug where it was reporting the number of entries with retention
Andrew DeFaria [Sun, 18 Jul 2021 00:39:14 +0000 (17:39 -0700)]
Fixed bug where it was reporting the number of entries with retention

2 years agoAdded message if DB was optimized
Andrew DeFaria [Sun, 18 Jul 2021 00:30:10 +0000 (17:30 -0700)]
Added message if DB was optimized

2 years agoMore enhancements to mapssrub
Andrew DeFaria [Sun, 18 Jul 2021 00:28:25 +0000 (17:28 -0700)]
More enhancements to mapssrub

2 years agoBug fixes for mapsscrub.pl
Andrew DeFaria [Sun, 18 Jul 2021 00:04:51 +0000 (17:04 -0700)]
Bug fixes for mapsscrub.pl

2 years agoFixed bug where AddLog was not properly adding timestamp
Andrew DeFaria [Sat, 17 Jul 2021 23:17:54 +0000 (16:17 -0700)]
Fixed bug where AddLog was not properly adding timestamp

2 years agoAdded use lib for clearscm
Andrew DeFaria [Sat, 17 Jul 2021 22:34:09 +0000 (15:34 -0700)]
Added use lib for clearscm

2 years agoWelcome to MAPS 2.0
Andrew DeFaria [Sat, 17 Jul 2021 21:56:45 +0000 (14:56 -0700)]
Welcome to MAPS 2.0

Major changes:

. New field called retention for the list table. Now, instead of aging
  the null list based on history, we age based on retention. Retention
  is specified in terms of <n> <period> such as "1 week", "2 days",
  "15 months", "3 years". Not a lot parsing of retention but that's OK
  since it's largely just me.

  This means that white and black lists are aged as well as the null
  list. This also means that no retention means that the list entry will
  not be removed. So we can say age white list entries if we haven't
  heard from that sender in say 2 years.
. Lots of changes to DB routines in the backend facilitated by a new
  Perl module - MyDB. This new Perl module handles the low level DB
  routines in a nice Perl way. Can also use MyDB in Clearadm later on.
. Lots of changes and code refactoring of MAPS.pm. Using more of a style
  of parameters passed by hash.
. The mapsscrub script now ages things as described above
. New color scheme. Nothing fancy but a little more pleasant on the eyes
. The mapsutil.pl script has been revamped to include usage of CmdLine
. Now using MySQL's AES encrypt/decrypt routines

2 years agoMerge branch 'master' of https://github.com/adefaria/clearscm
Andrew DeFaria [Sun, 11 Jul 2021 20:51:31 +0000 (13:51 -0700)]
Merge branch 'master' of https://github.com/adefaria/clearscm

2 years agoChanged announceEmail.pl to remove things like order numbers
Andrew DeFaria [Sun, 11 Jul 2021 20:51:03 +0000 (13:51 -0700)]
Changed announceEmail.pl to remove things like order numbers

2 years agoChanged announceEmail.pl to strip out things like order numbers
Andrew DeFaria [Sun, 11 Jul 2021 20:49:13 +0000 (13:49 -0700)]
Changed announceEmail.pl to strip out things like order numbers

2 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 6 Jul 2021 19:54:06 +0000 (12:54 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

2 years agoFixed up display.cgi and a small change to MAPS.pm
Andrew DeFaria [Tue, 6 Jul 2021 19:48:11 +0000 (12:48 -0700)]
Fixed up display.cgi and a small change to MAPS.pm

3 years agoAdded RequiredFields
Andrew DeFaria [Wed, 23 Jun 2021 00:12:48 +0000 (17:12 -0700)]
Added RequiredFields

3 years agoWhitespace cosmetic cleanup for Clearquest.pm
Andrew DeFaria [Wed, 23 Jun 2021 00:12:19 +0000 (17:12 -0700)]
Whitespace cosmetic cleanup for Clearquest.pm

3 years agoAdded .gitignore
Andrew DeFaria [Tue, 22 Jun 2021 20:46:31 +0000 (13:46 -0700)]
Added .gitignore

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 22 Jun 2021 20:44:55 +0000 (13:44 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoSimplified test.msg
Andrew DeFaria [Tue, 22 Jun 2021 20:43:27 +0000 (13:43 -0700)]
Simplified test.msg

3 years agoAdded secondary kill to announceEmail
Andrew DeFaria [Tue, 15 Jun 2021 18:38:24 +0000 (11:38 -0700)]
Added secondary kill to announceEmail

3 years agoCertbot renewal hook scripts
Andrew DeFaria [Fri, 4 Jun 2021 22:17:30 +0000 (15:17 -0700)]
Certbot renewal hook scripts

These scripts help automate Let's Encrypt domain renewal. The certbot
renew command offers --manual-authenticate-hook and
--manual-cleanup-hook to automate the process of renewal. For DNS domain
validation the authenticate script will be called with CERTBOT_DOMAIN
and CERTBOT_VALIDATION values filled in. We then add a TXT record to the
domain with the supplied value and enter into a loop checking for
propagation. If propagated the hook returns to certbot which renews the
cert. Cleanup consists of removing the TXT record.

3 years agoHopefully .gitignore will remain now
Andrew DeFaria [Fri, 4 Jun 2021 18:40:29 +0000 (11:40 -0700)]
Hopefully .gitignore will remain now

Also updated a few bins

3 years agoRemoved conf
Andrew DeFaria [Fri, 4 Jun 2021 18:39:53 +0000 (11:39 -0700)]
Removed conf

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Sat, 15 May 2021 00:54:59 +0000 (17:54 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoUpdated update system
Andrew DeFaria [Sat, 15 May 2021 00:54:46 +0000 (17:54 -0700)]
Updated update system

3 years agoUpdated update-system
Andrew DeFaria [Sat, 15 May 2021 00:44:45 +0000 (17:44 -0700)]
Updated update-system

3 years agoRemoved $tmpfile
Andrew DeFaria [Thu, 13 May 2021 17:51:14 +0000 (10:51 -0700)]
Removed $tmpfile

3 years agoChanged update-system to be less verbose
Andrew DeFaria [Thu, 13 May 2021 13:58:02 +0000 (06:58 -0700)]
Changed update-system to be less verbose

But to log things that are updated

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Wed, 12 May 2021 14:51:42 +0000 (07:51 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoFixed long standing bug about displaying proper message
Andrew DeFaria [Wed, 12 May 2021 14:49:31 +0000 (07:49 -0700)]
Fixed long standing bug about displaying proper message

If there were more than one message sent by the sender then attempting
to display the individual message would not work. This was because we
were going by msg_nbr but the msg_nbr did not really relate to the
message shown on the detail.cti web page. Here we change the alogrithm
to use the message date instead as it uniquely identifies the message.

Note that there still may be times when one sender/msg_date relates to
more than one message (think two messages with the exact same
timestamp). I'm not sure if this is possible nor if it's really that
important.

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Mon, 10 May 2021 20:12:01 +0000 (13:12 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoFinally added valid email address check!
Andrew DeFaria [Mon, 10 May 2021 20:11:51 +0000 (13:11 -0700)]
Finally added valid email address check!

3 years agoFixed long standing bug with '+' in email address
Andrew DeFaria [Mon, 10 May 2021 19:54:25 +0000 (12:54 -0700)]
Fixed long standing bug with '+' in email address

3 years agoUpdated update-system
Andrew DeFaria [Sat, 8 May 2021 14:19:12 +0000 (07:19 -0700)]
Updated update-system

3 years agoUpdated update system
Andrew DeFaria [Fri, 7 May 2021 16:17:16 +0000 (09:17 -0700)]
Updated update system

3 years agoRemoved announcement of reestablishment of tunnel
Andrew DeFaria [Fri, 7 May 2021 14:03:35 +0000 (07:03 -0700)]
Removed announcement of reestablishment of tunnel

3 years agoMinor changes
Andrew DeFaria [Wed, 5 May 2021 17:53:19 +0000 (10:53 -0700)]
Minor changes

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Wed, 5 May 2021 17:51:09 +0000 (10:51 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoChanges are:
Andrew DeFaria [Wed, 5 May 2021 17:44:47 +0000 (10:44 -0700)]
Changes are:

. Added another greeting to announceEmail.pl
. Removed a Perl::Critic warning for Unils.pm
. Changed message for Speak to use [silent]
. Created announceEmail sleep script

Actually not a sleep script but rather it is a script that needs to be
added to /lib/systemd/systemd-sleep (symlinked) so that when Ubuntu
20.04 comes out of suspend mode a USR2 signal is sent to all
announceEmail.pl processes. They then wake up and reconnect to their
IMAP hosts. This is necessary because the network is down during suspend
and Mail::IMAPTalk doesn't notice this so email announcements stop
happening. If instead Mail::IMAPTalk would have noticed this and
returned an error I could re-establish the connection in
announceEmail.pl but it doesn't.

Notice also that it takes 10-30 seconds to re-establish the network
connection after suspend so we just put a 60 second sleep in this script
rather than implementing a more complicated polling loop looking for the
network to come back up.