| 02:35.41 | *** join/#oe infobot (ibot@208.53.50.136) |
| 02:35.41 | *** topic/#oe is OpenEmbedded Developer Lounge | Web: http://openembedded.org | Repositories: http://git.openembedded.org/ | Primary Repo Mirrors: https://github.com/openembedded | This is not a distro or machine support channel |
| 03:13.58 | *** join/#oe infobot (ibot@208.53.50.136) |
| 03:13.58 | *** topic/#oe is OpenEmbedded Developer Lounge | Web: http://openembedded.org | Repositories: http://git.openembedded.org/ | Primary Repo Mirrors: https://github.com/openembedded | This is not a distro or machine support channel |
| 03:48.39 | *** join/#oe armpit (~armpit@2601:202:4180:c33:4de4:4bff:337d:ee91) |
| 04:39.59 | *** join/#oe stefan_schmidt (~stefan_sc@p200300E9D701780F9A8389FFFE2E3FAE.dip0.t-ipconnect.de) |
| 05:24.33 | *** join/#oe MarcWe (~hmw@zimbra.welvaarts.com) |
| 05:27.30 | *** join/#oe aehs29 (~aehs29@149.199.62.254) |
| 05:29.19 | *** join/#oe MarcWe (~hmw@zimbra.welvaarts.com) |
| 05:32.17 | *** join/#oe Jybz (~jibz@ip-37-201-6-235.hsi13.unitymediagroup.de) |
| 06:01.14 | *** join/#oe leon-anavi (~Leon@78.130.197.177) |
| 06:28.52 | *** join/#oe ao2 (~ao2@95.234.139.27) |
| 06:37.29 | *** join/#oe rob_w (~bob@unaffiliated/rob-w/x-1112029) |
| 06:50.42 | *** join/#oe Bunio_FH (~bunio@clj-165.netdrive.pl) |
| 07:01.29 | *** join/#oe florian (~florian_k@Maemo/community/contributor/florian) |
| 07:07.32 | *** join/#oe tnovotny (~tnovotny@185.41.76.141) |
| 07:09.29 | *** join/#oe cpriouzeau (~cpriouzea@164.129.115.76) |
| 07:25.27 | *** join/#oe yegorich (~yegorich@mail.visionsystems.de) |
| 07:26.36 | *** join/#oe florian_kc (~florian_k@Maemo/community/contributor/florian) |
| 07:28.04 | *** join/#oe Bunio_FH1 (~bunio@81-18-201-214.static.chello.pl) |
| 07:42.20 | *** join/#oe florian_kc (~florian_k@Maemo/community/contributor/florian) |
| 08:06.17 | *** join/#oe mckoan (~marco@unaffiliated/mckoan) |
| 08:06.30 | mckoan | good morning |
| 08:16.48 | *** join/#oe joseppc (~josep@linaro/joseppc) |
| 08:35.40 | *** join/#oe jkridner (~jkridner@pdpc/supporter/active/jkridner) |
| 08:59.10 | *** join/#oe JaMa (~martin@217.30.68.212) |
| 09:00.18 | *** join/#oe ptsneves (83e420a7@gateway/web/freenode/ip.131.228.32.167) |
| 09:19.08 | *** join/#oe nslu2-log (~nslu2-log@23.141.224.193) |
| 09:29.01 | *** join/#oe rburton (~textual@35.106.2.81.in-addr.arpa) |
| 09:35.27 | *** join/#oe tnovotny (~tnovotny@185.41.76.141) |
| 09:40.56 | *** join/#oe bluelightning_ (~paul@pdpc/supporter/professional/bluelightning) |
| 10:09.55 | *** join/#oe cpriouzeau (~cpriouzea@164.129.115.76) |
| 11:41.18 | *** join/#oe tnovotny (~tnovotny@185.41.76.141) |
| 11:48.55 | *** join/#oe georgem_home (uid210681@gateway/web/irccloud.com/x-casbbnpafghbdtdi) |
| 11:52.21 | *** join/#oe mort (~loungeuse@snow/mort96) |
| 11:53.12 | mort | Not sure if this necessarily is the correct channel, but: Writing a recipe for webrtc, I need to write my own do_fetch. One of the steps in fetching, using Google's tools, uses the xz binary to unzip something after downloading. Even though I depend on xz-native, the xz binary is only available some time after do_fetch. |
| 11:53.32 | mort | <PROTECTED> |
| 11:54.13 | mort | I would've asked this in a #bitbake IRC channel or something if that existed, but none of the IRC channels I've seen seem entirely relevant to issues related to building bitbake recipes |
| 12:15.43 | Crofton | this is a fine place to ask such questions |
| 12:17.09 | Crofton | You may need to fiddle with the depedns so it is complete for fetch, might be setup for antother task |
| 12:17.53 | Crofton | I'm not exactly sure how to debug this though |
| 12:18.36 | mort | I got some help in #yocto, apparently DEPENDS is a shortcut for do_compile[depends], it works when I use do_fetch[depends] |
| 12:18.58 | Crofton | yeah, that is what I thought might happen |
| 12:26.16 | mort | Crofton: do you by any chance know how I can make bitbake not re-run fetch? How does a fetcher tell bitbake that the file is already downloaded? |
| 12:31.07 | Crofton | the fetcher is not my area of expertise :) |
| 12:44.34 | *** join/#oe eduardas_m (~eduardas@213.197.143.19) |
| 12:47.32 | *** join/#oe volestorm_ (~volestorm@2400:8902::f03c:91ff:fe7f:f462) |
| 12:51.48 | *** join/#oe cpriouzeau (~cpriouzea@164.129.115.76) |
| 13:22.57 | *** join/#oe stephano (~stephano@134.134.139.75) |
| 13:53.17 | *** join/#oe otavio (~otavio@debian/developer/otavio) |
| 14:03.02 | *** join/#oe Laibsch (~Laibsch@110.54.244.241) |
| 14:04.25 | *** join/#oe andre_d (~user@77.107.218.170) |
| 14:06.44 | *** join/#oe andre_d (~user@77.107.218.170) |
| 14:12.56 | *** join/#oe AbleBacon (~AbleBacon@unaffiliated/ablebacon) |
| 16:05.17 | *** join/#oe Laibsch (~Laibsch@110.54.232.97) |
| 16:19.47 | *** join/#oe joseppc (~josep@linaro/joseppc) |
| 16:59.36 | khem | mort: usually you dont want to fight bitbake fetcher, I guess you are talking about depot_tools, I think its better for you to write a fetcher for it or may be something like this https://patchwork.openembedded.org/patch/90775/ |
| 16:59.41 | khem | will help you |
| 17:01.21 | kergoth | yeah, that's best done as a new fetcher |
| 17:02.45 | *** join/#oe leon-anavi (~Leon@78.130.197.177) |
| 17:03.52 | *** join/#oe falk0n (~falk0n@a109-49-51-30.cpe.netcabo.pt) |
| 17:06.05 | *** join/#oe falk0n (~falk0n@a109-49-51-30.cpe.netcabo.pt) |
| 18:27.45 | *** join/#oe fray (~fray@kernel.crashing.org) |
| 18:27.54 | *** join/#oe AbleBacon_ (~AbleBacon@unaffiliated/ablebacon) |
| 18:28.36 | fray | I found an issue with bitbake (have a fix), but I'm also trying to write a test case.. unfortunately the test case needs to look for bitbake output from a function (logger) to look for a problem.. |
| 18:28.58 | fray | but I can't get the test harness to get the UI output.. and I'm not sure what is wrong.. (I was trying to follow some examples in the bitbake event tests..) |
| 18:29.07 | fray | anyone here have any clues that might be able to help? |
| 18:29.12 | fray | http://git.openembedded.org/bitbake-contrib/commit/?h=mgh/cooker-fix&id=689fb757ede9bdabb704b04977ffc4f32f82ab0e |
| 18:29.26 | fray | (that is my work in progress.. fix for the issue is disabled, as I'm trying to make sure the test fails before I put in the fix) |
| 18:32.43 | *** join/#oe ao2 (~ao2@95.234.139.27) |
| 18:39.04 | kergoth | fray: there's a class in the oe-core qa tests to capture logger messages |
| 18:39.10 | kergoth | probably want something like that |
| 18:39.34 | *** join/#oe armpit (~armpit@64.2.3.196.ptr.us.xo.net) |
| 18:39.52 | kergoth | though actually i have a version that's a little nicer that i never got around to submitting, https://gist.github.com/kergoth/25ea6bed197b0355e4cf |
| 18:39.59 | kergoth | yawns |
| 18:40.34 | fray | kergoth, problem is this is all in bitbake |
| 18:40.36 | fray | no OE |
| 18:41.03 | kergoth | it's a pretty common thing to have to do, i see no reason you couldn't copy it into bitbake's unittest suite |
| 18:41.12 | fray | I have a feeling the real problem is that logger is disconnected between the cooker module and the test run, and it's the same damned proper again and again.. |
| 18:41.24 | fray | python for whatever reason in this stuff wants to use different loggers in differnet modules |
| 18:41.43 | kergoth | that's how logging is designed to be used |
| 18:41.47 | kergoth | it rolls up |
| 18:41.57 | fray | Thats how it's supposed to work, but it never seems to work |
| 18:42.14 | fray | I've had exactly the same problem with bitbake-layers/tinfoil and others.. logging just disappears from cooker and other pieces.. |
| 18:42.29 | kergoth | hmm, can't say i've ever run into that working on stuff using tinfoil before |
| 18:42.55 | kergoth | likely just the configuration of the log handler isn't matching your expectations, in which case you can just configure it differently for your purposes |
| 18:43.28 | fray | at this point I don't know why the logger is disconnected fromc ooker |
| 18:43.43 | fray | since they both seem to write to the stdout, but the print_ui_queue can't see them |
| 18:44.24 | kergoth | remember that cooker runs in the server, not the ui. the messeages have to make it from the server to the UI to be printed unless the server shuts down after the UI has become unavailable, in which case we manually flush them to stdout |
| 18:44.42 | fray | this is bitbake-selftest.. so there is no ui/etc.. and that is part of the problem |
| 18:44.57 | fray | I followed the instructions fromt he event.py to setup a ui, but it doesn't work |
| 18:45.23 | fray | and like I said, I'm sure the disconnect is that cooker is using a different logger then the test side.. but I don't have a clue how to conenct them |
| 18:45.29 | fray | (other then the example I tried) |
| 18:45.51 | kergoth | like i said, the cooker runs in the server |
| 18:45.55 | fray | what bugs me the most about this is 'logging.getLogger("Bitbake")' doesn't seem to return the same thing in different contexts |
| 18:46.03 | fray | I'm running a function of the cooker, not the actual cooker |
| 18:46.04 | kergoth | nowadays tinfoil connects to the server to do the job, and receives logging messages from it |
| 18:46.15 | fray | and there is no tinfoil in the test cases |
| 18:46.54 | kergoth | it sounds like you're doing getLogger() in both the server and client, they'll be differetn, as they're different processes |
| 18:46.56 | kergoth | shrugs |
| 18:46.58 | fray | whole test is essentially: |
| 18:47.00 | fray | collection = bb.cooker.CookerCollectFiles(bbfile_config_priorities) |
| 18:47.05 | fray | collection.collection_priorities(pkgfns, self.d) |
| 18:47.10 | fray | and check the logger for a warning message |
| 18:47.26 | kergoth | seems straightforward, capture the log messages in bb.cooker.logger |
| 18:47.27 | fray | but I can't get the loggers to work, and I don't understand why |
| 18:47.30 | kergoth | using the aforementioned class |
| 18:47.32 | kergoth | or manual |
| 18:48.43 | kergoth | if you intercept the messages in the logger, rather than the handler, the handler and formatting and printing shoudln't be a factor |
| 18:49.18 | fray | to intercept then in the logger, I'd have to write my own logger though wouldn't I? |
| 18:49.25 | fray | and then do something like bb.config.logger = myLogger |
| 18:49.27 | kergoth | no |
| 18:49.29 | fray | and hope it works? |
| 18:49.46 | kergoth | https://gist.github.com/kergoth/25ea6bed197b0355e4cf#file-logrecorder-py-L35 |
| 18:50.22 | kergoth | you just attach a custom handler to the logger that stores the messages rather than displaying them |
| 18:50.42 | kergoth | python logging allows multiple handlers and multiple filters on any logger |
| 18:51.15 | fray | when I get back to it I'll try.. but this is the biggest nitpick I have about the python stuff.. this logger stuff seems like it's global, but never is |
| 18:52.28 | kergoth | yeah, i'm not a big fan of the whole addressing a global index of loggers by name thing |
| 18:52.42 | kergoth | i''d rather just use objects and address them directly |
| 18:53.28 | *** join/#oe florian_kc (~florian_k@Maemo/community/contributor/florian) |
| 18:53.29 | fray | what kills me is it never seems to work right.. (global names) |
| 18:54.02 | *** join/#oe florian_kc (~florian_k@Maemo/community/contributor/florian) |
| 18:54.39 | kergoth | it doesn't help that you have to always be aware of what process you're running in, and the fact that we fork but don't exec doesn't make it less complicated |
| 19:19.54 | *** join/#oe AbleBacon_ (~AbleBacon@unaffiliated/ablebacon) |
| 19:21.03 | fray | kergoth is thre some magic to the handler? I tries something extremely simple: |
| 19:21.03 | fray | <PROTECTED> |
| 19:21.03 | fray | <PROTECTED> |
| 19:21.03 | fray | <PROTECTED> |
| 19:21.03 | fray | <PROTECTED> |
| 19:21.03 | fray | <PROTECTED> |
| 19:21.17 | fray | and it complains level is not defined.. if I define that then it's filter is not defined |
| 19:23.51 | fray | nm.. figured it out.. |
| 19:23.56 | fray | need to call the __init__ on the logging.Handler |
| 19:25.42 | kergoth | ah, good catch |
| 19:33.03 | fray | http://git.openembedded.org/bitbake-contrib/commit/?h=mgh/cooker-fix&id=aedeabafd6ff401d8d285d4cc81232492915f76d |
| 19:33.07 | fray | that has the updated stuff in it |
| 19:41.49 | *** join/#oe joseppc (~josep@linaro/joseppc) |
| 20:04.21 | *** join/#oe bluelightning (~paul@pdpc/supporter/professional/bluelightning) |
| 20:33.32 | *** join/#oe Jybz (~jibz@2a02:8071:9289:5900:4a51:b7ff:fe84:99e6) |
| 21:03.36 | *** part/#oe Laibsch (~Laibsch@110.54.232.97) |
| 21:33.57 | *** join/#oe georgem_home (uid210681@gateway/web/irccloud.com/x-biyphdqjptixflop) |
| 22:30.57 | *** join/#oe nerdboy (~sarnold@gentoo/developer/nerdboy) |
| 23:01.18 | *** join/#oe rburton (~textual@81.2.106.35) |
| 23:16.39 | *** join/#oe armpit (~armpit@2601:202:4180:c33:38e9:838d:a16e:18a5) |