blancco: CMMC evidence pack, ServiceNow tick list, cloud-upload status

Automates the Blancco parts of the onsite-support CMMC playbook:

- ENT-056/158 evidence pack: /reports/evidence?month=YYYY-MM returns
  ENT-056_<Site>_<YYYY-MM>.zip (summary.csv, README, each report's XML
  and PDF). pxe-blancco-evidence.timer saves last month's pack to the
  reports share's evidence/ folder on the 1st (Persistent).
- ENT-045/159 ServiceNow tick list: /reports/servicenow lists recent
  reports as "Wiped" or "Blancco Wipe failed" with a pre-written
  destruction note, copy buttons and Done (CSRF-protected).
- Cloud upload: blancco-progress.py posts each report's upload result
  ("Sending report document id" -> "Report sent to MC") to
  /reports/cloud-status (CSRF-exempt like /imaging/status); the Reports
  page and the CSVs show it, so a wipe missing from BMP is visible.
- CSV gains failure_reason (exception messages, failed steps, error
  counts), business_location and cloud_upload.
- Preferences: business_location "West Jefferson" (config.BLANCCO_SITE)
  and pdf+xml reports; the report copier now copies the PDF too, named
  after its XML. .part and hidden files are not listed as reports.

State (cloud confirmations, ServiceNow ticks) is a JSON file at
/var/lib/pxe-webapp/blancco-state.json, off the report share.

playbook/blancco-progress.py

@@ -21,6 +21,7 @@ import time
 import urllib.request
 
 STATUS_URL = "http://172.16.9.1:9009/imaging/status"
+CLOUD_URL = "http://172.16.9.1:9009/reports/cloud-status"
 STAGE_TOTAL = 7
 # Progress lines arrive in bursts; post at most this often unless the
 # stage itself changes.
@@ -69,6 +70,11 @@ RULES = [
     (re.compile(r"Report sent to MC"), 6, "Report sent to cloud", None),
     (re.compile(r"Auto process reached the final step"), 7, "Done", "succeeded"),
 ]
+# Cloud upload of a report: "[comm.manager] Sending report document id: <id>"
+# then "Report sent to MC" (or an upload failure).
+SENDING = re.compile(r"Sending report document id: ([0-9a-fA-F-]{36})")
+SENT = re.compile(r"Report sent to MC")
+SEND_FAILED = re.compile(r"(report (upload|send|sending)[^\n]*fail|failed to (send|upload) report)", re.I)
 # Drive progress, e.g. "FORMAT NVM progress: 75%". Excludes the self-test
 # completion and volume lines that also carry a percentage.
 PROGRESS = re.compile(r"\bprogress[^%\d]{0,20}(\d{1,3})%", re.I)
@@ -115,10 +121,35 @@ class Reporter:
         self.pending = []
         self.last_post = now
 
+    def cloud(self, document_id, sent, detail):
+        """Tell the webapp whether a report reached the Blancco cloud."""
+        payload = {"document_id": document_id, "serial": SERIAL,
+                   "sent": sent, "detail": detail[:200]}
+        if self.dry_run:
+            print(json.dumps({"cloud": payload}))
+            return
+        req = urllib.request.Request(
+            CLOUD_URL, data=json.dumps(payload).encode(),
+            headers={"Content-Type": "application/json"})
+        try:
+            urllib.request.urlopen(req, timeout=5).read()
+        except OSError:
+            pass
+
     def line(self, text):
         text = text.strip()
         if not text:
             return
+        m = SENDING.search(text)
+        if m:
+            self.sending = m.group(1)
+        elif getattr(self, "sending", None):
+            if SENT.search(text):
+                self.cloud(self.sending, True, text)
+                self.sending = None
+            elif SEND_FAILED.search(text):
+                self.cloud(self.sending, False, text)
+                self.sending = None
         for pat, idx, stage, status in RULES:
             m = pat.search(text)
             if not m: