gcmultimerge: multimerge.py annotate

annotate multimerge.py @ 9:01c933dba120

Filter source calendars based on regexp.

author	Matti Hamalainen <ccr@tnsp.org>
date	Mon, 04 Jul 2016 12:55:41 +0300
parents	8367463fe94d
children	b237b96602ad

rev	line source
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	1 #!/usr/bin/python
3 1e254756d0a5 Our code is UTF-8 Unicode. Matti Hamalainen <ccr@tnsp.org> parents: 2 diff changeset	2 # coding=utf-8
2 34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	3 ###
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	4 ### Google Calendar MultiMerge v0.000001
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	5 ### (C) 2016 Matti 'ccr' Hamalainen <ccr@tnsp.org>
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	6 ###
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	7 ### Python 2.7 <= x < 3 required! Please refer to
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	8 ### README.txt for information on other depencies.
34c3a08a4a37 Copyright, etc. Matti Hamalainen <ccr@tnsp.org> parents: 1 diff changeset	9 ###
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	10 import os
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	11 import sys
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	12 import signal
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	13 import re
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	14 import time
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	15 import datetime
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	16 import httplib2
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	17 import ConfigParser
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	18 import oauth2client
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	19 from oauth2client import client
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	20 from oauth2client import tools
4 ad1e3184c8e3 Add missing import. Matti Hamalainen <ccr@tnsp.org> parents: 3 diff changeset	21 from oauth2client import file
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	22 from googleapiclient import discovery
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	23
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	24
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	25 ###
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	26 ### Misc. helper functions
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	27 ###
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	28
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	29 ## Wrapper for print() that does not break when redirecting stdin/out
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	30 ## because of piped output not having a defined encoding. We default
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	31 ## to UTF-8 encoding in output here.
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	32 def gcm_print(smsg):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	33 gcm_msgbuf.append(smsg.encode("UTF-8"))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	34 if sys.stdout.encoding != None:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	35 print(smsg.encode(sys.stdout.encoding))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	36 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	37 print(smsg.encode("UTF-8"))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	38
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	39
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	40 ## Fatal errors
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	41 def gcm_fatal(smsg):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	42 gcm_print(u"ERROR: "+ smsg)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	43 sys.exit(1)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	44
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	45
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	46 ## Debug messages
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	47 def gcm_debug(smsg):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	48 if cfg.debug:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	49 gcm_print(u"DBG: "+ smsg)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	50 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	51 gcm_msgbuf.append(u"DBG: "+ smsg.encode("UTF-8"))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	52
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	53
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	54 ## Handle SIGINT signals here
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	55 def gcm_signal_handler(signal, frame):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	56 gcm_print("\nQuitting due to SIGINT / Ctrl+C!")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	57 sys.exit(0)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	58
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	59
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	60 def gcm_get_credentials(mcfg):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	61 store = oauth2client.file.Storage(mcfg.credential_file)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	62 credentials = store.get()
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	63 if not credentials or credentials.invalid:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	64 flow = client.flow_from_clientsecrets(mcfg.secret_file, mcfg.scope)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	65 flow.user_agent = mcfg.app_name
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	66 credentials = tools.run_flow(flow, store, mcfg)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	67 if not credentials or credentials.invalid:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	68 gcm_fatal("Failed to authenticate / invalid credentials.")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	69 return credentials
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	70
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	71
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	72 def gcm_dump_events(events):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	73 for event in events:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	74 ev_start = event["start"].get("dateTime", event["start"].get("date"))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	75 ev_end = event["end"].get("dateTime", event["end"].get("date"))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	76 gcm_print(u"{0:25} - {1:25} : {2}".format(ev_start, ev_end, event["summary"]))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	77
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	78
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	79 def gcm_is_str(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	80 return isinstance(mstr, basestring)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	81
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	82
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	83 def gcm_is_string(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	84 return mstr == None or gcm_is_str(mstr)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	85
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	86
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	87 def gcm_is_log_level(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	88 if not gcm_is_str(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	89 return False
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	90 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	91 return mstr.upper() in ["CRITICAL", "ERROR", "WARNING", "INFO", "DEBUG"]
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	92
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	93
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	94 def gcm_trans_log_level(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	95 return mstr.upper()
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	96
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	97
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	98 def gcm_is_filename(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	99 if not gcm_is_str(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	100 return False
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	101 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	102 return re.match("^[a-z0-9][a-z0-9\.\_\-]+$", mstr, flags=re.IGNORECASE)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	103
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	104
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	105 def gcm_trans_bool(mbool):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	106 if gcm_is_str(mbool):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	107 if re.match("^\s(true\|1\|on\|yes)\s$", mbool, re.IGNORECASE):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	108 mbool = True
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	109 elif re.match("^\s(false\|0\|off\|no)\s$", mbool, re.IGNORECASE):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	110 mbool = False
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	111 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	112 return None
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	113 return mbool
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	114
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	115 def gcm_is_bool(mbool):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	116 mval = gcm_trans_bool(mbool)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	117 if not isinstance(mval, bool):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	118 gcm_fatal("gcm_is_bool(): Invalid boolean value '{0}', should be true\|false\|1\|0\|on\|off\|yes\|no.".format(mbool))
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	119 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	120 return True
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	121
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	122
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	123 def gcm_trans_list(mlist):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	124 morig = mlist
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	125 if gcm_is_str(mlist):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	126 mlist = re.split("\s,\s", mlist, flags=re.IGNORECASE)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	127 if not isinstance(mlist, list):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	128 gcm_fatal("gcm_trans_list(): Could not parse list '{0}'.".format(mlist))
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	129 elif not isinstance(mlist, list):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	130 gcm_fatal("gcm_trans_list(): Invalid value '{0}'.".format(mlist))
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	131 return mlist
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	132
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	133 def gcm_is_list(mlist):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	134 return gcm_trans_list(mlist)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	135
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	136
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	137 def gcm_is_email(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	138 if not gcm_is_string(mstr):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	139 return False
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	140 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	141 return re.match("^.?\s+<[a-z0-9]+[a-z0-9\.\+\-]\@[a-z0-9]+[a-z0-9\.\-]+>\s$\|[a-z0-9]+[a-z0-9\.\+\-]\@[a-z0-9]+[a-z0-9\.\-]+", mstr, flags=re.IGNORECASE)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	142
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	143
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	144 def gcm_trans_email_list(mlist):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	145 if mlist == None:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	146 return mlist
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	147 else:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	148 return gcm_trans_list(mlist.strip())
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	149
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	150 def gcm_is_email_list(mlist):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	151 mlist = gcm_trans_email_list(mlist)
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	152 if mlist != None:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	153 for email in mlist:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	154 if not gcm_is_email(email):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	155 gcm_fatal("Invalid e-mail address '{0}' in list {1}.".format(email, ", ".join(mlist)))
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	156 return True
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	157
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	158
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	159
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	160 class GCMSettings(dict):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	161 def __init__(self):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	162 self.m_data = {}
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	163 self.m_saveable = {}
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	164 self.m_validate = {}
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	165 self.m_translate = {}
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	166
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	167 def __getattr__(self, name):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	168 if name in self.m_data:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	169 return self.m_data[name]
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	170 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	171 gcm_fatal("GCMSettings.__getattr__(): No such attribute '"+ name +"'.")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	172
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	173 def mvalidate(self, name, value):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	174 if name in self.m_validate and self.m_validate[name]:
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	175 if not self.m_validate[name](value):
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	176 gcm_fatal("GCMSettings.mvalidate(): Invalid value for attribute '{0}': {1}".format(name, value))
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	177
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	178 def mtranslate(self, name, value):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	179 if name in self.m_translate and self.m_translate[name]:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	180 return self.m_translate[name](value)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	181 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	182 return value
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	183
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	184 def mdef(self, name, saveable, validate, translate, value):
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	185 self.mvalidate(name, value)
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	186 self.m_saveable[name] = saveable
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	187 self.m_validate[name] = validate
9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	188 self.m_translate[name] = translate
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	189 self.m_data[name] = self.mtranslate(name, value)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	190
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	191 def mset(self, name, value):
5 9d4152f32223 Add some code for settings validation. Matti Hamalainen <ccr@tnsp.org> parents: 4 diff changeset	192 self.mvalidate(name, value)
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	193 if name in self.m_data:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	194 self.m_data[name] = self.mtranslate(name, value)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	195 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	196 gcm_fatal("GCMSettings.mset(): No such attribute '"+ name +"'.")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	197
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	198 def mget(self, name):
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	199 if name in self.m_data:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	200 return self.m_data[name]
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	201 else:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	202 return None
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	203
6 ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	204 def mread(self, cfgparser, sect):
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	205 for name in self.m_saveable:
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	206 if cfgparser.has_option(sect, name):
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	207 value = cfgparser.get(sect, name)
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	208 self.mset(name, value)
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	209 gcm_debug("{0} -> '{1}' == {2}".format(name, value, self.mget(name)))
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	210
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	211
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	212 ###
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	213 ### Main program starts
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	214 ###
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	215 gcm_msgbuf = []
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	216 signal.signal(signal.SIGINT, gcm_signal_handler)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	217
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	218
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	219 ## Settings
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	220 cfg = GCMSettings()
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	221
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	222 cfg.mdef("debug", True, gcm_is_bool, gcm_trans_bool, False)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	223
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	224 cfg.mdef("source_regex", True, gcm_is_string, None, "^R:\s(.?)\s$\s(.+?)\s$\s$")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	225 cfg.mdef("source_regmap", False, gcm_is_list, gcm_trans_list, [1, 2])
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	226 cfg.mdef("source_regmap_len", False, None, None, len(cfg.source_regmap))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	227
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	228 cfg.mdef("dest_name", True, gcm_is_string, None, u"Raahen kansainvälisyystoiminta")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	229 cfg.mdef("dest_id", True, gcm_is_string, None, None)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	230
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	231 cfg.mdef("noauth_local_webserver", False, None, None, True)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	232 #cfg.mdef("auth_host_name", False, None, None, "localhost")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	233 #cfg.mdef("auth_host_port", False, None, None, [8080, 8090])
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	234 cfg.mdef("logging_level", True, gcm_is_log_level, gcm_trans_log_level, "ERROR")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	235
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	236 # No need to touch these
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	237 cfg.mdef("app_name", False, None, None, "Google Calendar MultiMerge")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	238 cfg.mdef("scope", False, None, None, "https://www.googleapis.com/auth/calendar")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	239 #cfg.mdef("scope", False, None, None, "https://www.googleapis.com/auth/calendar.readonly")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	240 cfg.mdef("secret_file", True, gcm_is_filename, None, "client_secret.json")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	241 cfg.mdef("credential_file", True, gcm_is_filename, None, "client_credentials.json")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	242
6 ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	243
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	244 ## Read, parse and validate configuration file
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	245 if len(sys.argv) > 1:
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	246 gcm_debug("Reading configuration from '{0}'.".format(sys.argv[1]))
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	247 try:
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	248 cfgparser = ConfigParser.RawConfigParser()
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	249 cfgparser.read(sys.argv[1])
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	250 except Exception as e:
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	251 gcm_fatal("Failed to read configuration file '{0}': {1}".format(sys.argv[1], str(e)))
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	252
7 f2ecfb3e04ee Check that the required section exists in configuration. Matti Hamalainen <ccr@tnsp.org> parents: 6 diff changeset	253 # Check that the required section exists
f2ecfb3e04ee Check that the required section exists in configuration. Matti Hamalainen <ccr@tnsp.org> parents: 6 diff changeset	254 section = "gcm"
f2ecfb3e04ee Check that the required section exists in configuration. Matti Hamalainen <ccr@tnsp.org> parents: 6 diff changeset	255 if not cfgparser.has_section(section):
f2ecfb3e04ee Check that the required section exists in configuration. Matti Hamalainen <ccr@tnsp.org> parents: 6 diff changeset	256 gcm_fatal("Invalid configuration, missing '{0}' section.".format(section))
f2ecfb3e04ee Check that the required section exists in configuration. Matti Hamalainen <ccr@tnsp.org> parents: 6 diff changeset	257
6 ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	258 # Parse the settings and validate
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	259 cfg.mread(cfgparser, section)
ee6bf617f839 Implement configuration file reading. Matti Hamalainen <ccr@tnsp.org> parents: 5 diff changeset	260
8 8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	261
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	262 ## Validate settings
9 01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	263 if len(cfg.source_regmap) != cfg.source_regmap_len:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	264 gcm_fatal("Setting source_regmap list must be {0} items.".format(cfg.source_regmap_len))
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	265 else:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	266 # Force to integers
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	267 try:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	268 cfg.source_regmap = map(lambda x: int(x), cfg.source_regmap)
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	269 except Exception as e:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	270 gcm_fatal("Invalid source_regmap: {0}".format(str(e)))
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	271
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	272
8 8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	273 if not cfg.dest_name and not cfg.dest_id:
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	274 gcm_fatal("Target calendar ID or name required, but not set.")
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	275
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	276
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	277 if cfg.dest_name:
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	278 cfg.mset("dest_name", cfg.mget("dest_name").strip())
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	279
8367463fe94d Post-validate some settings. Matti Hamalainen <ccr@tnsp.org> parents: 7 diff changeset	280
1 74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	281 ## Initialize and authorize API connection
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	282 credentials = gcm_get_credentials(cfg)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	283 http = credentials.authorize(httplib2.Http())
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	284 service = discovery.build("calendar", "v3", http=http)
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	285
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	286
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	287 ## Fetch complete calendar list
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	288 gcm_debug("Fetching available calendars ..")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	289 calendars = []
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	290 calPageToken = None
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	291 while True:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	292 # We want everything except deleted and hidden calendars
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	293 calResult = service.calendarList().list(
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	294 showHidden=False,
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	295 showDeleted=False,
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	296 pageToken=calPageToken
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	297 ).execute()
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	298
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	299 calendars.extend(calResult.get("items", []))
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	300 calPageToken = calResult.get("nextPageToken")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	301 if not calPageToken:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	302 break
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	303
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	304 if len(calendars) == 0:
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	305 gcm_fatal("No calendars found?")
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	306
74f172565752 Initial import. Matti Hamalainen <ccr@tnsp.org> parents: diff changeset	307
9 01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	308 ## Filter desired SOURCE calendars based on specified regexp
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	309 src_re = re.compile(cfg.source_regex)
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	310 src_calendars = []
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	311 for calendar in calendars:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	312 if "summary" in calendar:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	313 if not cfg.dest_id and cfg.dest_name == calendar["summary"].strip():
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	314 cfg.mset("dest_id", calendar["id"])
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	315
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	316 mre = src_re.match(calendar["summary"])
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	317 if mre:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	318 calendar["gcm_title"] = mre.group(cfg.source_regmap[0])
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	319 calendar["gcm_id"] = mre.group(cfg.source_regmap[1])
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	320 src_calendars.append(calendar)
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	321
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	322
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	323 ## Check if we have target ID
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	324 if not cfg.dest_id:
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	325 gcm_fatal(u"Could not find target/destination calendar ID for '"+ cfg.dest_name +"'.")
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	326
01c933dba120 Filter source calendars based on regexp. Matti Hamalainen <ccr@tnsp.org> parents: 8 diff changeset	327

Mercurial > hg > gcmultimerge

annotate multimerge.py @ 9:01c933dba120