[mythtv-users] Issue with JobQueue Metadalookup

Greg Oliver oliver.greg at gmail.com
Thu May 3 05:08:40 UTC 2018


On Wed, May 2, 2018 at 4:24 PM, Ashu Desai <ashu.desai at gmail.com> wrote:

> On Tue, May 1, 2018 at 10:22 AM Greg Oliver <oliver.greg at gmail.com> wrote:
>
>> I am having an issue where mythbackend is not correctly doing the
>> metadata lookups (well, it is, but it is not returning results properly,
>> but when I run it from the command line (same command), it works).
>>
>> Anyone else see this and have a solution.  It has been failing like this
>> since I upgraded to 0.29 from 0.28 - in other words, *all* of my recordings
>> have no metadata other than what Schedules Direct provides since my upgrade.
>>
>> MythTV Version : v29.1-v29.1-8-g925ceea0fb
>> MythTV Branch : fixes/29
>> Network Protocol : 91
>> Library API : 29.20180131-3
>> QT Version : 5.9.4
>> Options compiled in:
>>  linux debug use_hidesyms using_alsa using_oss using_pulse
>> using_pulseoutput using_backend using_bdjava using_bindings_perl
>> using_bindings_python using_bindings_php using_crystalhd using_dvb
>> using_firewire using_frontend using_hdhomerun using_vbox using_ceton
>> using_hdpvr using_ivtv using_joystick_menu using_libcec using_libcrypto
>> using_libdns_sd using_libfftw3 using_libxml2 using_lirc using_mheg
>> using_opengl using_opengl_video using_opengl_themepainter using_qtwebkit
>> using_qtscript using_qtdbus using_taglib using_v4l2 using_x11 using_xrandr
>> using_xv using_debugtype using_systemd_notify using_systemd_journal
>> using_bdjava using_bindings_perl using_bindings_python using_bindings_php
>> using_fontconfig using_freetype2 using_mythtranscode using_opengl
>> using_vaapi using_vdpau using_ffmpeg_threads using_mheg using_libass
>> using_libxml2 using_libmp3lame
>>
>> Failed internal run::
>> 2018-05-01 10:12:57.075940 I [30383/30396] JobQueue jobqueue.cpp:197
>> (ProcessQueue) - JobQueue: Currently set to run up to 10 job(s) max.
>> 2018-05-01 10:12:57.077510 I [30383/30396] JobQueue jobqueue.cpp:1297
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: findJobs search bitmask 4,
>> found 14 total jobs
>> 2018-05-01 10:12:57.077643 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7111 @ 20180430000000 in Finished state.
>> 2018-05-01 10:12:57.077727 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7111 @ 20180430000000 in Finished state.
>> 2018-05-01 10:12:57.077806 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7051 @ 20180430020000 in Finished state.
>> 2018-05-01 10:12:57.077885 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7081 @ 20180430020100 in Finished state.
>> 2018-05-01 10:12:57.077964 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7081 @ 20180430020100 in Finished state.
>> 2018-05-01 10:12:57.078043 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7041 @ 20180501000000 in Finished state.
>> 2018-05-01 10:12:57.078122 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7041 @ 20180501000000 in Finished state.
>> 2018-05-01 10:12:57.078201 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7041 @ 20180501010000 in Finished state.
>> 2018-05-01 10:12:57.078280 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7041 @ 20180501010000 in Finished state.
>> 2018-05-01 10:12:57.078358 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7051 @ 20180501020100 in Finished state.
>> 2018-05-01 10:12:57.078437 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7081 @ 20180501020100 in Finished state.
>> 2018-05-01 10:12:57.078533 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7051 @ 20180501020100 in Finished state.
>> 2018-05-01 10:12:57.078620 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7051 @ 20180430020000 in Finished state.
>> 2018-05-01 10:12:57.078699 I [30383/30396] JobQueue jobqueue.cpp:1361
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Found 'Look up Metadata' Job
>> for chanid 7081 @ 20180501020100 in Queued state.
>> 2018-05-01 10:12:57.078833 I [30383/30396] JobQueue jobqueue.cpp:1168
>> (InJobRunWindow) - JobQueue: Currently set to run new jobs from 00:00 to
>> 23:59
>> 2018-05-01 10:12:57.078841 I [30383/30396] JobQueue jobqueue.cpp:249
>> (ProcessQueue) - JobQueue: Currently Running 0 jobs.
>> 2018-05-01 10:12:57.078861 I [30383/30396] JobQueue jobqueue.cpp:462
>> (ProcessQueue) - JobQueue: Processing 'Look up Metadata' job for chanid
>> 7081 @ 20180501020100, current status is 'Queued'
>> 2018-05-01 10:12:57.078878 I [30383/30396] JobQueue jobqueue.cpp:976
>> (ChangeJobStatus) - JobQueue: ChangeJobStatus(37023, Pending, '')
>> 2018-05-01 10:12:57.082473 I [30383/30396] JobQueue jobqueue.cpp:976
>> (ChangeJobStatus) - JobQueue: ChangeJobStatus(37023, Starting, '')
>> 2018-05-01 10:12:57.086550 I [30383/32132] Metadata_37023
>> jobqueue.cpp:2157 (DoMetadataLookupThread) - JobQueue: Metadata Lookup
>> Starting for "The Crossing":"Ten Years Gone" recorded from channel 7081 at
>> 2018-05-01T02:01:00Z
>> 2018-05-01 10:12:57.086562 I [30383/32132] Metadata_37023
>> jobqueue.cpp:2169 (DoMetadataLookupThread) - JobQueue: Running command:
>> '/usr/bin/mythmetadatalookup -j 37023 --verbose
>> general,jobqueue,record,system --logpath /var/log/mythtv --loglevel info'
>> 2018-05-01 10:12:57.088820 I [30383/32132] Metadata_37023
>> mythsystemunix.cpp:948 (Fork) - Managed child (PID: 32134) has started! *
>> command=/usr/bin/mythmetadatalookup -j 37023 --verbose
>> general,jobqueue,record,system --logpath /var/log/mythtv --loglevel info,
>> timeout=0
>> 2018-05-01 10:12:59.420936 I [30383/30405] ProcessRequest
>> mainserver.cpp:1738 (HandleAnnounce) - MainServer: MainServer::ANN Monitor
>> 2018-05-01 10:12:59.420957 I [30383/30405] ProcessRequest
>> mainserver.cpp:1743 (HandleAnnounce) - MainServer: adding:
>> backend-0(7f732021f660) as a client (events: 0)
>> 2018-05-01 10:12:59.422219 I [30383/30405] ProcessRequest
>> mainserver.cpp:1738 (HandleAnnounce) - MainServer: MainServer::ANN Monitor
>> 2018-05-01 10:12:59.422240 I [30383/30405] ProcessRequest
>> mainserver.cpp:1743 (HandleAnnounce) - MainServer: adding:
>> backend-0(ec9820) as a client (events: 1)
>> 2018-05-01 10:13:02.085083 I [30383/30396] JobQueue jobqueue.cpp:197
>> (ProcessQueue) - JobQueue: Currently set to run up to 10 job(s) max.
>> 2018-05-01 10:13:02.086594 I [30383/30396] JobQueue jobqueue.cpp:1297
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: findJobs search bitmask 4,
>> found 14 total jobs
>> 2018-05-01 10:13:02.086715 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7111 @ 20180430000000 in Finished state.
>> 2018-05-01 10:13:02.086798 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7111 @ 20180430000000 in Finished state.
>> 2018-05-01 10:13:02.086879 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7051 @ 20180430020000 in Finished state.
>> 2018-05-01 10:13:02.086960 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7081 @ 20180430020100 in Finished state.
>> 2018-05-01 10:13:02.087039 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7081 @ 20180430020100 in Finished state.
>> 2018-05-01 10:13:02.087119 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7041 @ 20180501000000 in Finished state.
>> 2018-05-01 10:13:02.087199 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7041 @ 20180501000000 in Finished state.
>> 2018-05-01 10:13:02.087278 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7041 @ 20180501010000 in Finished state.
>> 2018-05-01 10:13:02.087358 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7041 @ 20180501010000 in Finished state.
>> 2018-05-01 10:13:02.087438 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7051 @ 20180501020100 in Finished state.
>> 2018-05-01 10:13:02.087542 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Flag Commercials' Job
>> for chanid 7081 @ 20180501020100 in Finished state.
>> 2018-05-01 10:13:02.087629 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7051 @ 20180501020100 in Finished state.
>> 2018-05-01 10:13:02.087710 I [30383/30396] JobQueue jobqueue.cpp:1354
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Ignore 'Look up Metadata' Job
>> for chanid 7051 @ 20180430020000 in Finished state.
>> 2018-05-01 10:13:02.087794 I [30383/30396] JobQueue jobqueue.cpp:1361
>> (GetJobsInQueue) - JobQueue: GetJobsInQueue: Found 'Look up Metadata' Job
>> for chanid 7081 @ 20180501020100 in Starting state.
>> 2018-05-01 10:13:02.087930 I [30383/30396] JobQueue jobqueue.cpp:1168
>> (InJobRunWindow) - JobQueue: Currently set to run new jobs from 00:00 to
>> 23:59
>> 2018-05-01 10:13:02.087939 I [30383/30396] JobQueue jobqueue.cpp:249
>> (ProcessQueue) - JobQueue: Currently Running 1 jobs.
>> 2018-05-01 10:13:02.087959 I [30383/30396] JobQueue jobqueue.cpp:429
>> (ProcessQueue) - JobQueue: Skipping 'Look up Metadata' job for chanid 7081
>> @ 20180501020100, current job status is 'Starting'
>> 2018-05-01 10:13:02.515993 I [30383/32166] MythSocketThread(63)
>> mainserver.cpp:7643 (connectionClosed) - Monitor sock(7f732021f660)
>> 'backend-0' disconnected
>> 2018-05-01 10:13:02.516290 I [30383/32168] MythSocketThread(65)
>> mainserver.cpp:7643 (connectionClosed) - Monitor sock(ec9820) 'backend-0'
>> disconnected
>> 2018-05-01 10:13:02.569540 I [30383/31095] SystemManager
>> mythsystemunix.cpp:354 (run) - Managed child (PID: 32134) has exited!
>> command=/usr/bin/mythmetadatalookup -j 37023 --verbose
>> general,jobqueue,record,system --logpath /var/log/mythtv --loglevel info,
>> status=0, result=0
>> 2018-05-01 10:13:02.588082 I [30383/32132] Metadata_37023
>> jobqueue.cpp:976 (ChangeJobStatus) - JobQueue: ChangeJobStatus(37023,
>> Finished, 'Metadata Lookup Complete.')
>>
>> Successful from cmdline::
>> [greg at backend-0 .mythtv]$ /usr/bin/mythmetadatalookup -j 37023
>> 2018-05-01 10:13:58.419844 C  mythmetadatalookup version: fixes/29
>> [v29.1-v29.1-8-g925ceea0fb] www.mythtv.org
>> 2018-05-01 10:13:58.419872 C  Qt version: compile: 5.9.4, runtime: 5.9.4
>> 2018-05-01 10:13:58.419876 N  Enabled verbose msgs:  general
>> 2018-05-01 10:13:58.419888 N  Setting Log Level to LOG_INFO
>> 2018-05-01 10:13:58.430807 I  Added logging to the console
>> 2018-05-01 10:13:58.431064 I  Setup Interrupt handler
>> 2018-05-01 10:13:58.431076 I  Setup Terminated handler
>> 2018-05-01 10:13:58.431085 I  Setup Segmentation fault handler
>> 2018-05-01 10:13:58.431092 I  Setup Aborted handler
>> 2018-05-01 10:13:58.431100 I  Setup Bus error handler
>> 2018-05-01 10:13:58.431106 I  Setup Floating point exception handler
>> 2018-05-01 10:13:58.431114 I  Setup Illegal instruction handler
>> 2018-05-01 10:13:58.431122 I  Setup Real-time signal 0 handler
>> 2018-05-01 10:13:58.431132 I  Setup Hangup handler
>> 2018-05-01 10:13:58.431250 N  Using runtime prefix = /usr
>> 2018-05-01 10:13:58.431253 N  Using configuration directory =
>> /home/greg/.mythtv
>> 2018-05-01 10:13:58.431325 I  Assumed character encoding: en_US.UTF-8
>> 2018-05-01 10:13:58.431635 I  Using localhost value of backend-0
>> 2018-05-01 10:13:58.431683 I  Start up testing connections. DB localhost,
>> BE , attempt 0, status dbAwake
>> 2018-05-01 10:13:59.453541 N  Setting QT default locale to en_US
>> 2018-05-01 10:13:59.453562 I  Current locale en_US
>> 2018-05-01 10:13:59.453609 N  Reading locale defaults from
>> /usr/share/mythtv//locales/en_us.xml
>> 2018-05-01 10:13:59.459187 I  Loading en_us translation for module
>> mythfrontend
>> 2018-05-01 10:13:59.459534 I  Testing grabbers and metadata sites for
>> functionality...
>> 2018-05-01 10:13:59.460515 I  Starting process signal handler
>> 2018-05-01 10:13:59.460590 I  Starting IO manager (read)
>> 2018-05-01 10:13:59.460610 I  Starting process manager
>> 2018-05-01 10:13:59.462010 I  Starting IO manager (write)
>> 2018-05-01 10:14:00.664472 I  All grabbers tested and working.
>> Continuing...
>> 2018-05-01 10:14:00.672861 I  MythCoreContext::ConnectCommandSocket():
>> Connecting to backend server: 192.168.100.150:6543 (try 1 of 1)
>> 2018-05-01 10:14:00.674390 I  MythCoreContext::CheckProtoVersion():
>> Using protocol version 91 BuzzOff
>> 2018-05-01 10:14:00.965646 I  Running Grabber: /usr/share/mythtv/metadata/Television/ttvdb.py
>> -l en -a US -N The Crossing Ten Years Gone
>> 2018-05-01 10:14:02.974016 I  Result Found, Season 1 Episode 5
>> 2018-05-01 10:14:03.976843 I  Running Grabber: /usr/share/mythtv/metadata/Television/ttvdb.py
>> -l en -a US -N 328631 Ten Years Gone
>> 2018-05-01 10:14:04.429209 I  Result Found, Season 1 Episode 5
>> 2018-05-01 10:14:04.429361 I  Returning Metadata Results:  1 5
>> 2018-05-01 10:14:04.712769 I  Metadata Image Download:
>> http://www.thetvdb.com/banners/seasons/328631-1-2.jpg ->
>> myth://Coverart@backend-0/The Crossing Season 1_coverart.jpg
>> 2018-05-01 10:14:05.712159 I  Metadata Image Download:
>> http://www.thetvdb.com/banners/fanart/original/328631-3.jpg ->
>> myth://Fanart@backend-0/The Crossing Season 1_fanart.jpg
>> 2018-05-01 10:14:07.683855 N  MythMetadataLookup run complete.
>> 2018-05-01 10:14:07.683871 I  Waiting for threads to exit.
>>
>
> Have a similar issue of metadata lookup with "Videos" - it needs my
> "approval" for 90% of the movies as opposed to before where only a selected
> few needed to be manually selected.
>
> No solution, hoping something will turn out.
>
> ​I am not having the MythVideo issue you are - it is working fine for me
in that regard (only prompting when ultiple results are returned).​
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.mythtv.org/pipermail/mythtv-users/attachments/20180503/d50a2f97/attachment.html>


More information about the mythtv-users mailing list