[mythtv-commits] Ticket #12758: Feature patch: New feature for mythfilldatabase to optionally not use allatonce (--no-allatonce)

[MythTV]

#12758: Feature patch: New feature for mythfilldatabase to optionally not use
allatonce (--no-allatonce)
-------------------------------------------------+-------------------------
     Reporter:  Gary Buhrmaster                  |      Owner:  stuartm
  <gary.buhrmaster@…>                            |
         Type:  Patch - Feature                  |     Status:  new
     Priority:  minor                            |  Milestone:  unknown
    Component:  MythTV - Mythfilldatabase        |    Version:  Master Head
     Severity:  medium                           |   Keywords:
Ticket locked:  0                                |
-------------------------------------------------+-------------------------
 Feature patch: New feature for mythfilldatabase to optionally not use
 allatonce.

 The option added to mythfilldatabase is '--no-allatonce' and is (sort of)
 the equivalent to a no-dd-grab-all option (if it existed), --dd-grab-all
 not being the default due to some systems being under-provisioned.

 While for many grabbers that specify a preference for grabbing "allatonce"
 using it has advantages, for grabbers that return a large amount of data
 (example: 500+ channels for 21+ days with high details) mythfilldatabase
 due to its internal structure of parsing the entire xmltv file before
 processing can end up consuming vast amounts of virtual memory (6GB+ in
 one test case), which some backends may not be able to support well.

 This patch adds in a --no-allatonce option to mythfilldatabase which will
 cause the fill processing to fall back to a day at a time grab/fill,
 trading off invoking the grabber multiple times (with increased CPU
 procesing workload) for a reduced memory requirement.

 This patch should (likely) be removed when/if someone changes the entire
 mythfilldatabase processing to do chunked parsing and processing of the
 xmltv data (or the patch rejected in its entirely, in the case that that
 idea of chunked processing is on someones radar to be available RSN).

 github ref:
 https://github.com/garybuhrmaster/mythtv/commit/76bf320504f0749bc73aeb28389d798416178671

 github git-am ref:
 https://github.com/garybuhrmaster/mythtv/commit/76bf320504f0749bc73aeb28389d798416178671.patch

--
Ticket URL: <https://code.mythtv.org/trac/ticket/12758>
MythTV <http://www.mythtv.org>
MythTV Media Center