clearscm.git
2 years agoFixed RecordHit to update last_hit
Andrew DeFaria [Wed, 18 Aug 2021 20:52:46 +0000 (13:52 -0700)]
Fixed RecordHit to update last_hit

2 years agoFixed RecordHit
Andrew DeFaria [Wed, 18 Aug 2021 16:55:29 +0000 (09:55 -0700)]
Fixed RecordHit

2 years agoFixed bug in AddLog
Andrew DeFaria [Fri, 13 Aug 2021 12:31:20 +0000 (05:31 -0700)]
Fixed bug in AddLog

2 years agoOops! Forgot to include MAPS.pm
Andrew DeFaria [Thu, 12 Aug 2021 19:48:12 +0000 (12:48 -0700)]
Oops! Forgot to include MAPS.pm

2 years agoMore improvements
Andrew DeFaria [Thu, 12 Aug 2021 19:45:40 +0000 (12:45 -0700)]
More improvements

. Changed checkaddress.cgi to be more informative about other fields
  such as retention and comment.
. Changed maps main script to use full list record so as to allow the
  ability to report individual fields in the list record instead of just
  returning rule
. Changed detail.cgi to use list record instead of just rule
. Changed detail.cgi to handle corner cases where there are 1 less than
  the number of lines to be displayed.
. Added retention to Returned report
. Fixed font size problem with comment
. Made Checkaddress window a little bigger.
. MAPS.pm: Changed the way the ReturnSenders returns senders. A little
  more array manipulation but more accurate. Also made sure email
  addresses are downshifted before adding to log table.

2 years agoFixed menu
Andrew DeFaria [Sun, 8 Aug 2021 19:08:40 +0000 (12:08 -0700)]
Fixed menu

2 years agoUpdated announceEmail.pl
Andrew DeFaria [Sat, 7 Aug 2021 03:20:04 +0000 (20:20 -0700)]
Updated announceEmail.pl

And a few other scripts

2 years agoKilled long standing bug in Returned report
Andrew DeFaria [Thu, 5 Aug 2021 17:48:32 +0000 (10:48 -0700)]
Killed long standing bug in Returned report

Needed to compare >=

2 years agoAdded rule to logging
Andrew DeFaria [Tue, 27 Jul 2021 23:09:47 +0000 (16:09 -0700)]
Added rule to logging

2 years agoFixed but when attempting to nulllist people pretending to be me
Andrew DeFaria [Tue, 27 Jul 2021 20:06:34 +0000 (13:06 -0700)]
Fixed but when attempting to nulllist people pretending to be me

2 years agoMore changes to quickstats.
Andrew DeFaria [Tue, 27 Jul 2021 00:21:14 +0000 (17:21 -0700)]
More changes to quickstats.

2 years agoFixed quickstats
Andrew DeFaria [Fri, 23 Jul 2021 21:56:48 +0000 (14:56 -0700)]
Fixed quickstats

Well not totally fixed. There are still some CSS issues.

2 years agoFixing up numbers and totals
Andrew DeFaria [Thu, 22 Jul 2021 17:37:45 +0000 (10:37 -0700)]
Fixing up numbers and totals

Some areas like quickstats and total needed to use count_distinct so I
created MAPS::CountLogDistinct.

2 years agoMore fixes
Andrew DeFaria [Wed, 21 Jul 2021 05:19:55 +0000 (22:19 -0700)]
More fixes

. Fixed bug in maps where people pretending to me were getting through
. Changed table formatting to be more similar

2 years agoChanged to use Perl 5.026
Andrew DeFaria [Tue, 20 Jul 2021 19:07:26 +0000 (12:07 -0700)]
Changed to use Perl 5.026

2 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 20 Jul 2021 19:05:35 +0000 (12:05 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

2 years agoFixes to raid
Andrew DeFaria [Tue, 20 Jul 2021 19:05:02 +0000 (12:05 -0700)]
Fixes to raid

2 years agoStill tinkering with announceEmail
Andrew DeFaria [Tue, 20 Jul 2021 19:04:34 +0000 (12:04 -0700)]
Still tinkering with announceEmail

2 years agoSome changes to dot files
Andrew DeFaria [Tue, 20 Jul 2021 18:59:53 +0000 (11:59 -0700)]
Some changes to dot files

2 years agoFixed bug where adding a username only rule failed
Andrew DeFaria [Tue, 20 Jul 2021 18:59:01 +0000 (11:59 -0700)]
Fixed bug where adding a username only rule failed

2 years agoRearranged display for reports; fixed search.cgi
Andrew DeFaria [Tue, 20 Jul 2021 18:57:19 +0000 (11:57 -0700)]
Rearranged display for reports; fixed search.cgi

2 years agoFixed bug in search.cgi
Andrew DeFaria [Tue, 20 Jul 2021 13:36:11 +0000 (06:36 -0700)]
Fixed bug in search.cgi

2 years agoChanged CheckonList to append comment to rule if there is a comment
Andrew DeFaria [Mon, 19 Jul 2021 18:14:00 +0000 (11:14 -0700)]
Changed CheckonList to append comment to rule if there is a comment

2 years agoFixed bug with counting messages
Andrew DeFaria [Sun, 18 Jul 2021 04:18:19 +0000 (21:18 -0700)]
Fixed bug with counting messages

2 years agoFixed Resequence list to sort hit_count desc
Andrew DeFaria [Sun, 18 Jul 2021 03:44:16 +0000 (20:44 -0700)]
Fixed Resequence list to sort hit_count desc

2 years agoFixed bug where it was reporting the number of entries with retention
Andrew DeFaria [Sun, 18 Jul 2021 00:39:14 +0000 (17:39 -0700)]
Fixed bug where it was reporting the number of entries with retention

2 years agoAdded message if DB was optimized
Andrew DeFaria [Sun, 18 Jul 2021 00:30:10 +0000 (17:30 -0700)]
Added message if DB was optimized

2 years agoMore enhancements to mapssrub
Andrew DeFaria [Sun, 18 Jul 2021 00:28:25 +0000 (17:28 -0700)]
More enhancements to mapssrub

2 years agoBug fixes for mapsscrub.pl
Andrew DeFaria [Sun, 18 Jul 2021 00:04:51 +0000 (17:04 -0700)]
Bug fixes for mapsscrub.pl

2 years agoFixed bug where AddLog was not properly adding timestamp
Andrew DeFaria [Sat, 17 Jul 2021 23:17:54 +0000 (16:17 -0700)]
Fixed bug where AddLog was not properly adding timestamp

2 years agoAdded use lib for clearscm
Andrew DeFaria [Sat, 17 Jul 2021 22:34:09 +0000 (15:34 -0700)]
Added use lib for clearscm

2 years agoWelcome to MAPS 2.0
Andrew DeFaria [Sat, 17 Jul 2021 21:56:45 +0000 (14:56 -0700)]
Welcome to MAPS 2.0

Major changes:

. New field called retention for the list table. Now, instead of aging
  the null list based on history, we age based on retention. Retention
  is specified in terms of <n> <period> such as "1 week", "2 days",
  "15 months", "3 years". Not a lot parsing of retention but that's OK
  since it's largely just me.

  This means that white and black lists are aged as well as the null
  list. This also means that no retention means that the list entry will
  not be removed. So we can say age white list entries if we haven't
  heard from that sender in say 2 years.
. Lots of changes to DB routines in the backend facilitated by a new
  Perl module - MyDB. This new Perl module handles the low level DB
  routines in a nice Perl way. Can also use MyDB in Clearadm later on.
. Lots of changes and code refactoring of MAPS.pm. Using more of a style
  of parameters passed by hash.
. The mapsscrub script now ages things as described above
. New color scheme. Nothing fancy but a little more pleasant on the eyes
. The mapsutil.pl script has been revamped to include usage of CmdLine
. Now using MySQL's AES encrypt/decrypt routines

2 years agoMerge branch 'master' of https://github.com/adefaria/clearscm
Andrew DeFaria [Sun, 11 Jul 2021 20:51:31 +0000 (13:51 -0700)]
Merge branch 'master' of https://github.com/adefaria/clearscm

2 years agoChanged announceEmail.pl to remove things like order numbers
Andrew DeFaria [Sun, 11 Jul 2021 20:51:03 +0000 (13:51 -0700)]
Changed announceEmail.pl to remove things like order numbers

2 years agoChanged announceEmail.pl to strip out things like order numbers
Andrew DeFaria [Sun, 11 Jul 2021 20:49:13 +0000 (13:49 -0700)]
Changed announceEmail.pl to strip out things like order numbers

2 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 6 Jul 2021 19:54:06 +0000 (12:54 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

2 years agoFixed up display.cgi and a small change to MAPS.pm
Andrew DeFaria [Tue, 6 Jul 2021 19:48:11 +0000 (12:48 -0700)]
Fixed up display.cgi and a small change to MAPS.pm

3 years agoAdded RequiredFields
Andrew DeFaria [Wed, 23 Jun 2021 00:12:48 +0000 (17:12 -0700)]
Added RequiredFields

3 years agoWhitespace cosmetic cleanup for Clearquest.pm
Andrew DeFaria [Wed, 23 Jun 2021 00:12:19 +0000 (17:12 -0700)]
Whitespace cosmetic cleanup for Clearquest.pm

3 years agoAdded .gitignore
Andrew DeFaria [Tue, 22 Jun 2021 20:46:31 +0000 (13:46 -0700)]
Added .gitignore

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Tue, 22 Jun 2021 20:44:55 +0000 (13:44 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoSimplified test.msg
Andrew DeFaria [Tue, 22 Jun 2021 20:43:27 +0000 (13:43 -0700)]
Simplified test.msg

3 years agoAdded secondary kill to announceEmail
Andrew DeFaria [Tue, 15 Jun 2021 18:38:24 +0000 (11:38 -0700)]
Added secondary kill to announceEmail

3 years agoCertbot renewal hook scripts
Andrew DeFaria [Fri, 4 Jun 2021 22:17:30 +0000 (15:17 -0700)]
Certbot renewal hook scripts

These scripts help automate Let's Encrypt domain renewal. The certbot
renew command offers --manual-authenticate-hook and
--manual-cleanup-hook to automate the process of renewal. For DNS domain
validation the authenticate script will be called with CERTBOT_DOMAIN
and CERTBOT_VALIDATION values filled in. We then add a TXT record to the
domain with the supplied value and enter into a loop checking for
propagation. If propagated the hook returns to certbot which renews the
cert. Cleanup consists of removing the TXT record.

3 years agoHopefully .gitignore will remain now
Andrew DeFaria [Fri, 4 Jun 2021 18:40:29 +0000 (11:40 -0700)]
Hopefully .gitignore will remain now

Also updated a few bins

3 years agoRemoved conf
Andrew DeFaria [Fri, 4 Jun 2021 18:39:53 +0000 (11:39 -0700)]
Removed conf

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Sat, 15 May 2021 00:54:59 +0000 (17:54 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoUpdated update system
Andrew DeFaria [Sat, 15 May 2021 00:54:46 +0000 (17:54 -0700)]
Updated update system

3 years agoUpdated update-system
Andrew DeFaria [Sat, 15 May 2021 00:44:45 +0000 (17:44 -0700)]
Updated update-system

3 years agoRemoved $tmpfile
Andrew DeFaria [Thu, 13 May 2021 17:51:14 +0000 (10:51 -0700)]
Removed $tmpfile

3 years agoChanged update-system to be less verbose
Andrew DeFaria [Thu, 13 May 2021 13:58:02 +0000 (06:58 -0700)]
Changed update-system to be less verbose

But to log things that are updated

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Wed, 12 May 2021 14:51:42 +0000 (07:51 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoFixed long standing bug about displaying proper message
Andrew DeFaria [Wed, 12 May 2021 14:49:31 +0000 (07:49 -0700)]
Fixed long standing bug about displaying proper message

If there were more than one message sent by the sender then attempting
to display the individual message would not work. This was because we
were going by msg_nbr but the msg_nbr did not really relate to the
message shown on the detail.cti web page. Here we change the alogrithm
to use the message date instead as it uniquely identifies the message.

Note that there still may be times when one sender/msg_date relates to
more than one message (think two messages with the exact same
timestamp). I'm not sure if this is possible nor if it's really that
important.

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Mon, 10 May 2021 20:12:01 +0000 (13:12 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoFinally added valid email address check!
Andrew DeFaria [Mon, 10 May 2021 20:11:51 +0000 (13:11 -0700)]
Finally added valid email address check!

3 years agoFixed long standing bug with '+' in email address
Andrew DeFaria [Mon, 10 May 2021 19:54:25 +0000 (12:54 -0700)]
Fixed long standing bug with '+' in email address

3 years agoUpdated update-system
Andrew DeFaria [Sat, 8 May 2021 14:19:12 +0000 (07:19 -0700)]
Updated update-system

3 years agoUpdated update system
Andrew DeFaria [Fri, 7 May 2021 16:17:16 +0000 (09:17 -0700)]
Updated update system

3 years agoRemoved announcement of reestablishment of tunnel
Andrew DeFaria [Fri, 7 May 2021 14:03:35 +0000 (07:03 -0700)]
Removed announcement of reestablishment of tunnel

3 years agoMinor changes
Andrew DeFaria [Wed, 5 May 2021 17:53:19 +0000 (10:53 -0700)]
Minor changes

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Wed, 5 May 2021 17:51:09 +0000 (10:51 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoChanges are:
Andrew DeFaria [Wed, 5 May 2021 17:44:47 +0000 (10:44 -0700)]
Changes are:

. Added another greeting to announceEmail.pl
. Removed a Perl::Critic warning for Unils.pm
. Changed message for Speak to use [silent]
. Created announceEmail sleep script

Actually not a sleep script but rather it is a script that needs to be
added to /lib/systemd/systemd-sleep (symlinked) so that when Ubuntu
20.04 comes out of suspend mode a USR2 signal is sent to all
announceEmail.pl processes. They then wake up and reconnect to their
IMAP hosts. This is necessary because the network is down during suspend
and Mail::IMAPTalk doesn't notice this so email announcements stop
happening. If instead Mail::IMAPTalk would have noticed this and
returned an error I could re-establish the connection in
announceEmail.pl but it doesn't.

Notice also that it takes 10-30 seconds to re-establish the network
connection after suspend so we just put a 60 second sleep in this script
rather than implementing a more complicated polling loop looking for the
network to come back up.

3 years agoRemoved debug statements
Andrew DeFaria [Fri, 9 Apr 2021 18:10:17 +0000 (11:10 -0700)]
Removed debug statements

3 years agoMoved this script into clearscm
Andrew DeFaria [Fri, 9 Apr 2021 18:07:49 +0000 (11:07 -0700)]
Moved this script into clearscm

3 years agoRemoved python project attributes
Andrew DeFaria [Thu, 8 Apr 2021 17:54:08 +0000 (10:54 -0700)]
Removed python project attributes

3 years agoAdded to cleantmp.conf and reformat of MAPSStyle.css
Andrew DeFaria [Wed, 7 Apr 2021 16:02:03 +0000 (09:02 -0700)]
Added to cleantmp.conf and reformat of MAPSStyle.css

3 years agoRemoved tabs from MAPSStyle.css
Andrew DeFaria [Fri, 19 Mar 2021 16:34:02 +0000 (09:34 -0700)]
Removed tabs from MAPSStyle.css

3 years agoStandardized to create logfiles anew instead of append.
Andrew DeFaria [Tue, 16 Mar 2021 01:19:58 +0000 (18:19 -0700)]
Standardized to create logfiles anew instead of append.

3 years agoFixed ICANN end date
Andrew DeFaria [Mon, 15 Mar 2021 21:03:55 +0000 (14:03 -0700)]
Fixed ICANN end date

3 years agoAdded dot files, updated cleantmp.conf and gitignore
Andrew DeFaria [Tue, 9 Mar 2021 20:49:50 +0000 (12:49 -0800)]
Added dot files, updated cleantmp.conf and gitignore

3 years agoUpdated stty command, turned off numbers and spaces
Andrew DeFaria [Tue, 2 Mar 2021 21:37:31 +0000 (13:37 -0800)]
Updated stty command, turned off numbers and spaces

3 years agoMoved user log files to /var/local/log
Andrew DeFaria [Fri, 26 Feb 2021 16:43:04 +0000 (08:43 -0800)]
Moved user log files to /var/local/log

3 years agoAdded credential store to ~/.git-credentials
Andrew DeFaria [Fri, 26 Feb 2021 16:42:42 +0000 (08:42 -0800)]
Added credential store to ~/.git-credentials

3 years agoRemoved old tunnel. Implemented speak bin
Andrew DeFaria [Wed, 24 Feb 2021 20:22:38 +0000 (12:22 -0800)]
Removed old tunnel. Implemented speak bin

3 years agoMoved Say -> Speak::speak
Andrew DeFaria [Wed, 24 Feb 2021 19:47:38 +0000 (11:47 -0800)]
Moved Say -> Speak::speak

3 years agoAdded USR1 handling
Andrew DeFaria [Wed, 24 Feb 2021 04:33:12 +0000 (20:33 -0800)]
Added USR1 handling

3 years agoRemoved .gitignore
Andrew DeFaria [Tue, 23 Feb 2021 23:49:49 +0000 (15:49 -0800)]
Removed .gitignore

.gitingnore should be checked into git.

3 years agoReset retryattempts when successfully reestablishing tunnel
Andrew DeFaria [Sun, 21 Feb 2021 19:52:09 +0000 (11:52 -0800)]
Reset retryattempts when successfully reestablishing tunnel

3 years agoAdded global git pull rebase setting
Andrew DeFaria [Sun, 21 Feb 2021 19:44:47 +0000 (11:44 -0800)]
Added global git pull rebase setting

3 years agoSome changes for Jupiter
Andrew DeFaria [Sun, 21 Feb 2021 19:43:23 +0000 (11:43 -0800)]
Some changes for Jupiter

3 years agoNew tunnel.pl
Andrew DeFaria [Fri, 19 Feb 2021 22:21:25 +0000 (14:21 -0800)]
New tunnel.pl

This now handles establishing the ssh tunnel for the propose of
tunneling email. Will handle restarting tunnel if it fails.

Still need to be able to test if the ssh tunnel is responding when the
network is switched to the VPN and back.

3 years agoAdded global gitignore
Andrew DeFaria [Fri, 19 Feb 2021 19:51:37 +0000 (11:51 -0800)]
Added global gitignore

3 years agoAdded global gitignore
Andrew DeFaria [Fri, 19 Feb 2021 19:47:31 +0000 (11:47 -0800)]
Added global gitignore

3 years agoMove from http -> https
Andrew DeFaria [Fri, 19 Feb 2021 19:46:49 +0000 (11:46 -0800)]
Move from http -> https

3 years agoAdded click here image
Andrew DeFaria [Fri, 19 Feb 2021 19:05:54 +0000 (11:05 -0800)]
Added click here image

3 years agoChanged register handling
Andrew DeFaria [Fri, 19 Feb 2021 19:01:16 +0000 (11:01 -0800)]
Changed register handling

After years of people ignoring the bounce back message I determined that
it was best to just highlight how to click the fucking link and register
and not describe anything about MAPS or rather offload that description
only to those curious enough to actually read the message and find the
link that gave them more info. This caused me to describe move in
doc/index.php

3 years agoUpdated help
Andrew DeFaria [Wed, 17 Feb 2021 20:32:40 +0000 (12:32 -0800)]
Updated help

3 years agoChanged resume once again
Andrew DeFaria [Wed, 17 Feb 2021 20:32:10 +0000 (12:32 -0800)]
Changed resume once again

3 years agoChanged resume once again
Andrew DeFaria [Wed, 17 Feb 2021 20:30:43 +0000 (12:30 -0800)]
Changed resume once again

3 years agoUpdated images
Andrew DeFaria [Tue, 16 Feb 2021 02:25:37 +0000 (18:25 -0800)]
Updated images

3 years agoStoring credentials
Andrew DeFaria [Tue, 16 Feb 2021 00:26:41 +0000 (16:26 -0800)]
Storing credentials

3 years agoUpdate resume
Andrew DeFaria [Tue, 16 Feb 2021 00:26:19 +0000 (16:26 -0800)]
Update resume

Added certs and classes
Reformated clients under ClearSCM and DeFaria.com

3 years agoUpdated Resume
Andrew DeFaria [Sat, 30 Jan 2021 17:16:19 +0000 (10:16 -0700)]
Updated Resume

3 years agoFixed EOY issue
Andrew DeFaria [Fri, 1 Jan 2021 23:09:39 +0000 (16:09 -0700)]
Fixed EOY issue

3 years agoMade CheckAddress dialog box bigger
Andrew DeFaria [Thu, 12 Nov 2020 18:51:02 +0000 (11:51 -0700)]
Made CheckAddress dialog box bigger

3 years agoMerge branch 'master' of git+ssh://github.com/adefaria/clearscm
Andrew DeFaria [Fri, 30 Oct 2020 20:40:03 +0000 (13:40 -0700)]
Merge branch 'master' of git+ssh://github.com/adefaria/clearscm

3 years agoUpdated copyright date
Andrew DeFaria [Fri, 30 Oct 2020 20:39:23 +0000 (13:39 -0700)]
Updated copyright date

3 years agoUpdated copyright date
Andrew DeFaria [Fri, 30 Oct 2020 18:07:05 +0000 (11:07 -0700)]
Updated copyright date

3 years agoAdded checking for shh file to be quite
Andrew DeFaria [Fri, 16 Oct 2020 16:37:15 +0000 (09:37 -0700)]
Added checking for shh file to be quite

3 years agoChanged to properly handle backspace when entering passwords
Andrew DeFaria [Fri, 16 Oct 2020 16:36:23 +0000 (09:36 -0700)]
Changed to properly handle backspace when entering passwords