<html>
<head>
<style><!--
.hmmessage P
{
margin:0px;
padding:0px
}
body.hmmessage
{
font-size: 10pt;
font-family:Tahoma
}
--></style>
</head>
<body class='hmmessage'>
Well, I've spent the last two days trying to isolate the problem.<br><br>It
turns out there were more than one:<br><br>I think the conversion of
the non-ascii storage group path relates to #8530, but it only creates
problem if the top storage group folder includes non-ascii characters.
Subfolders are scanned ok.<br><br>the command:<br><br>mysql -umythtv -p
mythconverg -e 'status;' <br><br>on my old database was giving me:<br><br>Server
characterset: latin1<br>Db characterset: latin1<br>Client
characterset: utf8<br>Conn. characterset: utf8<br><br>whilst the
newly created in opensuse 11.2 <br><br>Server characterset: utf8<br>Db
characterset: utf8<br>Client characterset: utf8<br>Conn.
characterset: utf8<br><br>I included in my /etc/my.cnf under [mysqld]<br>default-character-set=latin1<br>character_set_server=latin1<br><br>and
fixed that part (of course, I recreated the database)<br><br>Now, the
main problem that I am still facing, and for which I would appreciate
any help, is that the backend cannot scan video folders that include
non-ascii subfolders or files but only when it is started by the
/etc/init.d/mythbackend script.<br><br>If I start mythbackend as the
mythtv user or root, and start mythfrontend on another terminal,
everything is perfectly ok and the database gets updated with the
videos.<br><br>I scanned some old tickets (including one of mine) and
came accross #7487. I think it is very similar to that.<br><br>Here is a very small part of the log (mythfrontend -v all)
that shows what the frontend reads in the folders. It actually creates
incremental paths with tens of '/' until it stops and starts on the next
file. It's almost fun to watch!<br><br>---------------------<br>2010-07-27 20:23:57.159 MythVideo::ScanVideoDirectory Scanning Group (myth://Videos@al2kpro/myth/video/)<br>2010-07-27 20:23:57.160 MSqlQuery::exec(DBManager0) SELECT DISTINCT dirname FROM storagegroup WHERE groupname = 'Videos' AND hostname = 'al2kpro' <<<< Returns 1 row(s)<br>2010-07-27 20:23:57.160 MSqlQuery::next(DBManager0) Result: "dirname = /myth/video/"<br>2010-07-27 20:23:57.160 MythSocket(189e410:32): write -> 32 66 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video/[]:[]0<br>2010-07-27 20:23:57.160 MythSocket(189e410:32): writeBlock(0x34198648, 74)<br>2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33681224, 8) called<br>2010-07-27 20:23:57.163 MythSocket(189e410:32): readBlock(0x33682008, 143) called<br>2010-07-27 20:23:57.163 MythSocket(189e410:32): read <- 32 143 dir::al2kpro::0[]:[]file::folder.jpg::0[]:[]file::mythtv_backup.sql::2549872[]:[]dir::storage::0[]:[]file::storage.txt::37[]:[]dir::torrents::0<br>2010-07-27 20:23:57.163 Got data on select<br>2010-07-27 20:23:57.163 Processing ready reads<br>2010-07-27 20:23:57.163 MythSocket(189e410:32): write -> 32 74 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro[]:[]0<br>2010-07-27 20:23:57.163 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.163 Reacquired ready read lock<br>2010-07-27 20:23:57.163 MythSocket(189e410:32): writeBlock(0x33682712, 82)<br>2010-07-27 20:23:57.163 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.163 Construct FD_SET<br>2010-07-27 20:23:57.163 Waiting on select..<br>2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33681704, 8) called<br>2010-07-27 20:23:57.165 MythSocket(189e410:32): readBlock(0x33682856, 200) called<br>2010-07-27 20:23:57.165 MythSocket(189e410:32): read <- 32 200 file::Babylon AD.mkv::2066189725[]:[]dir::Comedies::0[]:[]dir::Documentaries::0[]:[]dir::Historical::0[]:[]dir::Social::0[]:[]dir::Thrillers::0[]:[]dir::TV::0[]:[]dir::Videos::0[]:[]dir::War Movies::0<br>2010-07-27 20:23:57.165 Got data on select<br>2010-07-27 20:23:57.165 Processing ready reads<br>2010-07-27 20:23:57.165 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.165 Reacquired ready read lock<br>2010-07-27 20:23:57.165 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.165 Construct FD_SET<br>2010-07-27 20:23:57.165 Waiting on select..<br>2010-07-27 20:23:57.165 MythSocket(189e410:32): write -> 32 83 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Comedies[]:[]0<br>2010-07-27 20:23:57.165 MythSocket(189e410:32): writeBlock(0x33681512, 91)<br>2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33682280, 8) called<br>2010-07-27 20:23:57.167 MythSocket(189e410:32): readBlock(0x33683448, 203) called<br>2010-07-27 20:23:57.167 MythSocket(189e410:32): read <- 32 203 file::Big Buck Bunny.avi::928670754[]:[]file::folder.jpg::80751[]:[]file::Fun with Dick and Jane.avi::1128029272[]:[]file::Mamma Mia.mkv::1710559055[]:[]file::What Did You Do at War Daddy.avi::1461189334<br>2010-07-27 20:23:57.167 Got data on select<br>2010-07-27 20:23:57.167 Processing ready reads<br>2010-07-27 20:23:57.167 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.167 Reacquired ready read lock<br>2010-07-27 20:23:57.167 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.167 Construct FD_SET<br>2010-07-27 20:23:57.167 Waiting on select..<br>2010-07-27 20:23:57.168 MythSocket(189e410:32): write -> 32 88 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Documentaries[]:[]0<br>2010-07-27 20:23:57.168 MythSocket(189e410:32): writeBlock(0x33683704, 96)<br>2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881256, 8) called<br>2010-07-27 20:23:57.169 MythSocket(189e410:32): readBlock(0x34881608, 56) called<br>2010-07-27 20:23:57.169 MythSocket(189e410:32): read <- 32 56 file::1453.avi::714827674[]:[]file::kemal.avi::823369268<br>2010-07-27 20:23:57.169 Got data on select<br>2010-07-27 20:23:57.169 Processing ready reads<br>2010-07-27 20:23:57.169 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.169 Reacquired ready read lock<br>2010-07-27 20:23:57.169 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.169 Construct FD_SET<br>2010-07-27 20:23:57.169 Waiting on select..<br>2010-07-27 20:23:57.169 MythSocket(189e410:32): write -> 32 85 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical[]:[]0<br>2010-07-27 20:23:57.169 MythSocket(189e410:32): writeBlock(0x33682088, 93)<br>2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x33681656, 8) called<br>2010-07-27 20:23:57.171 MythSocket(189e410:32): readBlock(0x34003512, 176) called<br>2010-07-27 20:23:57.171 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.171 Got data on select<br>2010-07-27 20:23:57.171 Processing ready reads<br>2010-07-27 20:23:57.171 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.171 Reacquired ready read lock<br>2010-07-27 20:23:57.171 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.171 Construct FD_SET<br>2010-07-27 20:23:57.171 Waiting on select..<br>2010-07-27 20:23:57.171 MythSocket(189e410:32): write -> 32 86 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/[]:[]0<br>2010-07-27 20:23:57.171 MythSocket(189e410:32): writeBlock(0x34883176, 94)<br>2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x33683176, 8) called<br>2010-07-27 20:23:57.173 MythSocket(189e410:32): readBlock(0x34883320, 176) called<br>2010-07-27 20:23:57.173 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.173 Got data on select<br>2010-07-27 20:23:57.173 Processing ready reads<br>2010-07-27 20:23:57.173 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.173 Reacquired ready read lock<br>2010-07-27 20:23:57.173 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.173 Construct FD_SET<br>2010-07-27 20:23:57.173 Waiting on select..<br>2010-07-27 20:23:57.173 MythSocket(189e410:32): write -> 32 87 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//[]:[]0<br>2010-07-27 20:23:57.173 MythSocket(189e410:32): writeBlock(0x36206008, 95)<br>2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x33999816, 8) called<br>2010-07-27 20:23:57.174 MythSocket(189e410:32): readBlock(0x36205592, 176) called<br>2010-07-27 20:23:57.174 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.174 Got data on select<br>2010-07-27 20:23:57.175 Processing ready reads<br>2010-07-27 20:23:57.175 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.175 Reacquired ready read lock<br>2010-07-27 20:23:57.175 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.175 Construct FD_SET<br>2010-07-27 20:23:57.175 Waiting on select..<br>2010-07-27 20:23:57.175 MythSocket(189e410:32): write -> 32 88 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical///[]:[]0<br>2010-07-27 20:23:57.175 MythSocket(189e410:32): writeBlock(0x36207736, 96)<br>2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36205752, 8) called<br>2010-07-27 20:23:57.176 MythSocket(189e410:32): readBlock(0x36207048, 176) called<br>2010-07-27 20:23:57.176 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.176 Got data on select<br>2010-07-27 20:23:57.176 Processing ready reads<br>2010-07-27 20:23:57.176 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.176 Reacquired ready read lock<br>2010-07-27 20:23:57.176 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.176 Construct FD_SET<br>2010-07-27 20:23:57.176 Waiting on select..<br>2010-07-27 20:23:57.176 MythSocket(189e410:32): write -> 32 89 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical////[]:[]0<br>2010-07-27 20:23:57.176 MythSocket(189e410:32): writeBlock(0x36209464, 97)<br>2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36207208, 8) called<br>2010-07-27 20:23:57.178 MythSocket(189e410:32): readBlock(0x36208776, 176) called<br>2010-07-27 20:23:57.178 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.178 Got data on select<br>2010-07-27 20:23:57.178 Processing ready reads<br>2010-07-27 20:23:57.178 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.178 Reacquired ready read lock<br>2010-07-27 20:23:57.178 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.178 Construct FD_SET<br>2010-07-27 20:23:57.178 Waiting on select..<br>2010-07-27 20:23:57.178 MythSocket(189e410:32): write -> 32 90 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical/////[]:[]0<br>2010-07-27 20:23:57.178 MythSocket(189e410:32): writeBlock(0x36211192, 98)<br>2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36208936, 8) called<br>2010-07-27 20:23:57.180 MythSocket(189e410:32): readBlock(0x36210248, 176) called<br>2010-07-27 20:23:57.180 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.180 Got data on select<br>2010-07-27 20:23:57.180 Processing ready reads<br>2010-07-27 20:23:57.180 MythSocketThread: Total read time: 0ms, on sockets<br>2010-07-27 20:23:57.180 Reacquired ready read lock<br>2010-07-27 20:23:57.180 ProcessAddRemoveQueues<br>2010-07-27 20:23:57.180 Construct FD_SET<br>2010-07-27 20:23:57.180 Waiting on select..<br>2010-07-27 20:23:57.180 MythSocket(189e410:32): write -> 32 91 QUERY_SG_GETFILELIST[]:[]al2kpro[]:[]Videos[]:[]/myth/video//al2kpro/Historical//////[]:[]0<br>2010-07-27 20:23:57.180 MythSocket(189e410:32): writeBlock(0x36213112, 99)<br>2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x34882136, 8) called<br>2010-07-27 20:23:57.181 MythSocket(189e410:32): readBlock(0x36212696, 176) called<br>2010-07-27 20:23:57.181 MythSocket(189e410:32): read <- 32 176 dir::::0[]:[]file::El Greco.mkv::1899086664[]:[]file::Elizabeth: The Golden Age.avi::1702932678[]:[]dir::English::0[]:[]file::folder.jpg::31459[]:[]file::Gandhi.mkv::3099756668<br>2010-07-27 20:23:57.181 Got data on select<br>---------------------<br><br><br><br><br>Can somebody guess what the
mythbackend script misses out and cannot scan non-ascii files?<br><br>Sorry
for topposting before, that's hotmail's fault.<br><br>Thanks,<br><br>Yianni. </body>
</html>