02:04.15 | *** join/#maemo-ssu amiconn_ (amiconn@rockbox/developer/amiconn) |
03:03.37 | *** join/#maemo-ssu DocScrutinizer05 (~HaleBopp@openmoko/engineers/joerg) |
03:09.37 | *** join/#maemo-ssu discopig (~discopig@2001:5c0:1400:a::c1) |
03:09.37 | *** join/#maemo-ssu discopig (~discopig@unaffiliated/discopig) |
03:14.54 | *** join/#maemo-ssu discopig (~discopig@unaffiliated/discopig) |
03:45.23 | *** join/#maemo-ssu b-r-a-i-n (~admin@188.168.202.135) |
04:07.14 | *** join/#maemo-ssu DocScrutinizer05 (~HaleBopp@openmoko/engineers/joerg) |
04:07.30 | *** join/#maemo-ssu FlameReaper (~assassin@175.138.113.32) |
04:12.43 | *** join/#maemo-ssu n900-dk_ (~kgu@freebox.dk) |
04:15.48 | *** join/#maemo-ssu ruskie (ruskie@sourcemage/mage/ruskie) |
04:36.19 | *** join/#maemo-ssu unclouded (~neil@2001:4428:200:80fc:bca1:78d3:6f28:2a02) |
05:49.20 | *** join/#maemo-ssu dhbiker (~dhbiker@95.87.145.172) |
06:07.42 | *** join/#maemo-ssu XDS2010 (uid1218@gateway/web/irccloud.com/x-yvfnojuovxdriyul) |
06:11.31 | *** join/#maemo-ssu LauRoman (~LauRoman@5-14-93-43.residential.rdsnet.ro) |
06:42.44 | *** join/#maemo-ssu Vlad_on_the_road (~Vlad_on_t@ip-66.net-82-216-1.versailles2.rev.numericable.fr) |
07:09.44 | *** join/#maemo-ssu M13 (~MirandaLS@170.133-224-87.telenet.ru) |
08:18.55 | *** join/#maemo-ssu sixwheeledbeast (~paul@cl-1547.lon-02.gb.sixxs.net) |
08:19.38 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
08:24.45 | *** join/#maemo-ssu iDont (~iDont@ip4da305b4.direct-adsl.nl) |
08:32.17 | *** join/#maemo-ssu kolp (~quassel@212.255.244.155) |
08:45.33 | *** join/#maemo-ssu xes (~xes@unaffiliated/xes) |
08:59.12 | *** join/#maemo-ssu LauRoman (~LauRoman@5-14-93-43.residential.rdsnet.ro) |
09:12.54 | *** join/#maemo-ssu futpib (~futpib@89.106.197.47) |
09:13.20 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
10:03.34 | *** join/#maemo-ssu M4rtinK (~M4rtinK@mail.melf.eu) |
10:37.09 | *** join/#maemo-ssu ShadowX (~7350@darknet.escom.bg) |
10:52.56 | *** join/#maemo-ssu sixwheeledbeast (~paul@cl-1547.lon-02.gb.sixxs.net) |
10:53.16 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
11:10.12 | *** join/#maemo-ssu arcean (~arcean@aacy132.neoplus.adsl.tpnet.pl) |
11:11.31 | chem|st | http://maemo.org/community/council/hifocouncil-hifo_board_of_directors_elections/ |
11:46.29 | *** join/#maemo-ssu arcean_ (~arcean@aacs65.neoplus.adsl.tpnet.pl) |
11:50.33 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
12:23.02 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
12:41.54 | *** join/#maemo-ssu NIN101 (~NIN@p5DD29A1B.dip0.t-ipconnect.de) |
13:18.53 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
14:27.59 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
14:30.45 | *** join/#maemo-ssu oldtopman (~oldtopman@unaffiliated/oldtopman) |
15:15.58 | *** join/#maemo-ssu nox- (noident@freebsd/developer/nox) |
15:22.13 | DocScrutinizer05 | freemangordon_: merlin1991: http://talk.maemo.org/showthread.php?p=1348641#post1348641 |
15:24.20 | DocScrutinizer05 | chem|st: freemangordon_: merlin1991: ^^^ please answer in a new thread. this topic seems not related to general admin. chem|st please take care to move any answers plus initial two posts to a new thread, if any get posted |
15:24.51 | DocScrutinizer05 | freemangordon_: would you maybe like to /join ##maemo-admin ? |
15:48.56 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
15:49.28 | chem|st | http://talk.maemo.org/showthread.php?t=90314 |
15:49.35 | chem|st | new thread |
15:50.11 | *** join/#maemo-ssu sixwheeledbeast (~paul@cl-1547.lon-02.gb.sixxs.net) |
15:57.18 | *** join/#maemo-ssu arcean_ (~arcean@aacs65.neoplus.adsl.tpnet.pl) |
16:41.37 | *** join/#maemo-ssu _rd (~rd@p5088F861.dip0.t-ipconnect.de) |
16:46.03 | DocScrutinizer05 | thanks |
16:52.19 | Sc0rpius | that's a very weird issue |
16:52.28 | Sc0rpius | it's like somebody wiped the whole "stage" server |
16:52.46 | Sc0rpius | and it was fine yesteday |
16:52.51 | Sc0rpius | yesterday |
17:22.08 | *** join/#maemo-ssu Pali (~pali@Maemo/community/contributor/Pali) |
17:37.22 | DocScrutinizer05 | nfc what *is* stage server |
17:37.36 | DocScrutinizer05 | we have no stage server |
17:38.01 | Sc0rpius | but that's what the URLs say... |
17:38.12 | DocScrutinizer05 | yes, they look completely weird |
17:38.14 | Sc0rpius | and it works for some failes |
17:38.15 | Sc0rpius | files |
17:38.19 | Sc0rpius | Get:1 http://stage fremantle Release.gpg [490B] |
17:38.26 | Sc0rpius | Get:3 http://stage fremantle/free Packages [10.4MB] |
17:38.27 | Sc0rpius | etc. |
17:39.57 | DocScrutinizer05 | joerg@MAEMOBUILDER1:~$ wget http://stage |
17:39.59 | DocScrutinizer05 | --2013-06-01 17:39:21-- http://stage/ |
17:40.00 | DocScrutinizer05 | Resolving stage (stage)... 213.128.137.22 |
17:40.02 | DocScrutinizer05 | Connecting to stage (stage)|213.128.137.22|:80... connected. |
17:40.03 | DocScrutinizer05 | HTTP request sent, awaiting response... 200 OK |
17:40.05 | Sc0rpius | it does resolve! |
17:40.15 | Sc0rpius | but somebody wiped all packages there :( |
17:40.38 | DocScrutinizer05 | hard to believe |
17:41.50 | DocScrutinizer05 | actually stage *is* stage.maemo.org, the stage for repository.maemo.org |
17:42.23 | DocScrutinizer05 | so builder fetching stuff from http://stage actually means it's just accessing repository |
17:43.02 | DocScrutinizer05 | ~rmo |
17:43.03 | infobot | hmm... rmo is repository.maemo.org |
17:43.44 | DocScrutinizer05 | we nuked stage during migration#2 |
17:43.58 | Sc0rpius | rmo a smo have the same IP? |
17:44.02 | DocScrutinizer05 | see http://wiki.maemo.org/Migrating_to_Community-driven_Infrastructure |
17:44.11 | DocScrutinizer05 | yes |
17:44.39 | DocScrutinizer05 | same VM sibe rmo no longer on akamai server farm |
17:44.45 | DocScrutinizer05 | since* |
17:44.52 | Sc0rpius | then this is extremely weird |
17:44.58 | Sc0rpius | for example: |
17:45.02 | Sc0rpius | Failed to fetch http://stage/extras-devel/pool/fremantle/free/m/mawk/mawk_1.3.3-11.1_armel.deb 404 Not Found |
17:45.13 | Sc0rpius | but if I change stage to stage.maemo.org and access it from here I can see the package |
17:45.24 | Sc0rpius | so I wonder if stage is resolving correctly inside the builder |
17:45.34 | DocScrutinizer05 | see above |
17:45.55 | DocScrutinizer05 | HTTP request sent, awaiting response... 200 OK |
17:45.57 | DocScrutinizer05 | Length: unspecified [text/html] |
17:45.58 | DocScrutinizer05 | Saving to: `index.html' |
17:46.00 | DocScrutinizer05 | <PROTECTED> |
17:46.01 | DocScrutinizer05 | 2013-06-01 17:39:21 (17.2 MB/s) - `index.html' saved [15348] |
17:46.02 | Sc0rpius | and even weirdest: yesterday was working fine |
17:47.02 | Sc0rpius | hmm |
17:47.07 | Sc0rpius | look this DocScrutinizer05: |
17:47.13 | Sc0rpius | http://stage.maemo.org/extras-devel/pool/fremantle/free/m/mawk/ |
17:47.18 | Sc0rpius | click on any package there |
17:47.27 | DocScrutinizer05 | joerg@MAEMOBUILDER1:~$ wget http://stage/extras-devel/pool/fremantle/free/m/mawk/mawk_1.3.3-11.1_armel.deb |
17:47.29 | DocScrutinizer05 | --2013-06-01 17:47:12-- http://stage/extras-devel/pool/fremantle/free/m/mawk/mawk_1.3.3-11.1_armel.deb |
17:47.30 | DocScrutinizer05 | Resolving stage (stage)... 213.128.137.22 |
17:47.32 | DocScrutinizer05 | Connecting to stage (stage)|213.128.137.22|:80... connected. |
17:47.33 | DocScrutinizer05 | HTTP request sent, awaiting response... 404 Not Found |
17:47.40 | Sc0rpius | yeah but in the INDEX |
17:47.43 | Sc0rpius | you can see them |
17:47.49 | Sc0rpius | <Sc0rpius> http://stage.maemo.org/extras-devel/pool/fremantle/free/m/mawk/ <-- there |
17:48.11 | Sc0rpius | but if I click on one of those packages in my browser I get 404 |
17:48.19 | Sc0rpius | how come they are in the index then? |
17:48.45 | DocScrutinizer05 | might be some of those friggin cronjobs that messed up stuff in repo |
17:48.57 | DocScrutinizer05 | please pester merlin1991 to look into it |
17:49.02 | Sc0rpius | heh ok |
17:49.11 | DocScrutinizer05 | since I have no clue about repo issues either |
17:49.45 | DocScrutinizer05 | merlin1991 at least should know how it *should* look like and what's the actual difference to how it *does* look |
17:51.31 | DocScrutinizer05 | we might have killed a job on www.m.o by readjusting memlimits. Since all jobs are run via cron invoking lynx invoking apache:80 involing phpd (SIC!), we might have creared problems for a job that builds the index, or whatever |
17:51.41 | *** join/#maemo-ssu BigBo____ (~BigBoxDri@p4FF9A790.dip0.t-ipconnect.de) |
17:51.42 | DocScrutinizer05 | created* |
17:51.47 | Sc0rpius | lynx? |
17:51.52 | Sc0rpius | I haven't heard that word since like 1989 |
17:52.25 | DocScrutinizer05 | yeah, go figure |
17:53.10 | DocScrutinizer05 | cron(!!!) invoking webpages locally to accomplish some job written in php. I might never again stop puking |
17:56.37 | DocScrutinizer05 | please read the mini-description jacekowski gave to us: http://wiki.maemo.org/Migrating_to_Community-driven_Infrastructure#Autobuilder_and_friends - and try to find out what I shall look into |
17:58.20 | DocScrutinizer05 | http://wiki.maemo.org/Migrating_to_Community-driven_Infrastructure#repository.2Fstage_VM |
17:58.37 | DocScrutinizer05 | I think I've seen a "stuck" rsync job in top |
18:09.54 | DocScrutinizer05 | http://privatepaste.com/0d2aef2af8 |
18:10.10 | DocScrutinizer05 | tell me what you want to look at |
18:10.38 | DocScrutinizer05 | I'll pastebin whatever you are interested in (after inspecting it for hardcoded passwords etc) |
18:16.02 | DocScrutinizer05 | http://privatepaste.com/93b742bc61 |
18:17.22 | DocScrutinizer05 | http://privatepaste.com/a113708b4f |
18:19.36 | DocScrutinizer05 | http://privatepaste.com/16be686713 |
18:19.56 | DocScrutinizer05 | sorry not my domain of expertise |
18:24.53 | DocScrutinizer05 | nad don't get fooled by me looking into those scripts/jobs, maybe they are *completely* unrelated |
18:29.02 | *** join/#maemo-ssu sixwheeledbeast (~paul@cl-1547.lon-02.gb.sixxs.net) |
18:32.40 | DocScrutinizer05 | anyway our changes we did were done to apache on www VM, not on builder and not on stage/repo |
18:33.49 | DocScrutinizer05 | and those jobs on stage/repo look like decent proper bashscript jobs |
18:33.59 | DocScrutinizer05 | unrelated to apache |
18:34.28 | *** join/#maemo-ssu XDS2010 (uid1218@gateway/web/irccloud.com/x-zdonwzslofuqirll) |
18:37.29 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
18:43.55 | sixwheeledbeast | Have the IP addresses here changed? http://wiki.maemo.org/Migrating_to_Community-driven_Infrastructure#More_Detailed_Information |
18:44.58 | sixwheeledbeast | It seems so but when did that happen? |
18:52.37 | DocScrutinizer05 | hmm? |
18:53.53 | DocScrutinizer05 | sixwheeledbeast: that's obsolete stuff related to migra#1 aka nemein interim |
18:54.07 | DocScrutinizer05 | see above for current "new" info |
18:54.23 | sixwheeledbeast | also noticed stage.maemo.org/bar/foo/bar/foobar_armel.deb is missing, but repository.maemo.org/bar/foo/bar/foobar_armel.deb is there. I have tested this on a number of packages. |
18:54.23 | sixwheeledbeast | k no prob |
18:56.59 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
18:58.27 | DocScrutinizer05 | sixwheeledbeast: the find two above still holds true? |
18:59.15 | DocScrutinizer05 | for all practical purposes stage.m.o and repository.m.o should act and be identical |
18:59.33 | sixwheeledbeast | yes i thought so. |
18:59.43 | DocScrutinizer05 | your find however - if it's actually correct - could explain the problems |
19:00.50 | sixwheeledbeast | That's why I mention :) |
19:01.25 | DocScrutinizer05 | please provide a particular test case |
19:01.31 | sixwheeledbeast | http://stage.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/ http://repository.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/ |
19:01.59 | DocScrutinizer05 | work both just fine here |
19:02.07 | sixwheeledbeast | stage = 4040 repoistory = download |
19:02.14 | sixwheeledbeast | s/4040/404/ |
19:02.25 | DocScrutinizer05 | not here |
19:03.34 | DocScrutinizer05 | absolutely identical down to the window title, so konqueror shows a <2> on the http://repository.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/ window |
19:04.05 | sixwheeledbeast | this is only true on /extras-devel/* for me |
19:04.12 | sixwheeledbeast | extras is fine |
19:05.15 | DocScrutinizer05 | to be clear: when switching between http://stage.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/ and http://repository.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/ windows, I see only URL changing |
19:05.58 | DocScrutinizer05 | both browser windows otherwise look 100% identical (except the "<2> appended to window title of the latter) |
19:06.46 | DocScrutinizer05 | (since it been the second of two identical windows I opened concurrently) |
19:07.19 | sixwheeledbeast | No sorry... |
19:07.40 | sixwheeledbeast | Try to download the armel.deb in them! |
19:08.05 | sixwheeledbeast | the pages are the same but the files are missing in one |
19:10.23 | sixwheeledbeast | this is true for all packages (files) in /extras-devel/* |
19:13.09 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
19:15.12 | DocScrutinizer05 | ouch |
19:15.33 | sixwheeledbeast | sorry did I explain better this time :) |
19:15.49 | DocScrutinizer05 | yes |
19:16.04 | DocScrutinizer05 | now THIS is for sure sth techstaff can look into |
19:16.28 | DocScrutinizer05 | and also potentually explains the autobuilder problems |
19:16.35 | DocScrutinizer05 | thanks a lot |
19:16.36 | sixwheeledbeast | Glad I can be of service :) |
19:19.22 | *** join/#maemo-ssu Martix_ (~martix@4.177.broadband3.iol.cz) |
19:21.18 | *** join/#maemo-ssu Martix_ (~martix@4.177.broadband3.iol.cz) |
19:25.05 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
19:28.34 | DocScrutinizer05 | ok, I think I found out what happened: tabletsdev lives on r.m.o |
19:29.05 | DocScrutinizer05 | yesterday we put tabletsdev.m.o to purpose - I bet we broke stage.m.o during that |
19:29.39 | DocScrutinizer05 | probably warfare added a rewrite rule that applies to everything not repository.maemo.org |
19:31.12 | DocScrutinizer05 | so stay tuned while we wait for somebody picking up on the workpackage and fixes that |
19:35.03 | *** join/#maemo-ssu sunny_s (~sunny_s@business-092-079-020-027.static.arcor-ip.net) |
19:36.37 | DocScrutinizer05 | NFC, the apache repository vhost config file has: |
19:36.39 | DocScrutinizer05 | <PROTECTED> |
19:36.40 | DocScrutinizer05 | <PROTECTED> |
19:37.09 | DocScrutinizer05 | I'll leave that to warfare... |
19:40.24 | DocScrutinizer05 | actually repository vhost config hasn't changed at all, just a tabletsdev vhost config file got added |
19:40.40 | DocScrutinizer05 | and I can't see why this one breaks stage.m.o |
19:44.45 | DocScrutinizer05 | marxian around? |
19:45.06 | DocScrutinizer05 | Sc0rpius: around? |
19:45.49 | DocScrutinizer05 | Sc0rpius: could you try to build a pkg that failed, after I temporarily removed /etc/apache2/sites-enabled/tabletsdev ? |
19:46.43 | DocScrutinizer05 | please highlight me if you're ready to do so, so I can remove the vhost |
19:47.01 | Sc0rpius | ok |
19:47.11 | Sc0rpius | building it now |
19:47.56 | DocScrutinizer05 | sorry too fast |
19:48.00 | DocScrutinizer05 | :-S |
19:48.19 | DocScrutinizer05 | please reread my last 3 lines |
19:49.17 | Sc0rpius | hehehe |
19:49.18 | Sc0rpius | ok |
19:51.07 | Sc0rpius | ok it failed, so I can try again if you want just lemme know if you're ready |
19:53.00 | DocScrutinizer05 | ok, please retry |
19:53.04 | Sc0rpius | ok |
19:53.08 | DocScrutinizer05 | stop!! |
19:53.17 | DocScrutinizer05 | first need to restart apache |
19:53.38 | Sc0rpius | ok |
19:54.12 | DocScrutinizer05 | ok, now |
19:54.39 | Sc0rpius | it's building now, I'm waiting for the mail |
19:55.26 | DocScrutinizer05 | I should've tested http://stage.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/lanterne_0.4.0_armel.deb instead |
19:55.32 | DocScrutinizer05 | which still gives 404 |
19:55.34 | DocScrutinizer05 | :-/ |
19:57.00 | Sc0rpius | https://garage.maemo.org/builder/fremantle/yappari_0.0.34/armel.root.log.FAILED.txt |
19:57.05 | Sc0rpius | it fails with the same erros |
19:57.07 | Sc0rpius | errors |
20:00.00 | DocScrutinizer05 | yeah, and I can't make http://stage.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/lanterne_0.4.0_armel.deb act like http://repository.maemo.org/extras-devel/pool/fremantle/free/l/lanterne/lanterne_0.4.0_armel.deb |
20:00.09 | *** join/#maemo-ssu sixwheeledbeast (~paul@host-78-144-106-108.as13285.net) |
20:00.17 | *** join/#maemo-ssu xes (~xes@unaffiliated/xes) |
20:00.34 | DocScrutinizer05 | almost feels like my removing of tabketsdev vhost has no effects at all |
20:00.48 | DocScrutinizer05 | so nevermind, I'll leave that to somebody else |
20:00.54 | DocScrutinizer05 | i.e. warfare |
20:02.58 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
20:03.53 | *** join/#maemo-ssu BigBoxDr_ (~BigBoxDri@p4FF9A790.dip0.t-ipconnect.de) |
20:15.36 | *** join/#maemo-ssu sixwheeledbeast (~paul@host-2-98-137-208.as13285.net) |
20:21.54 | *** join/#maemo-ssu LauRoman (~LauRoman@5-14-93-43.residential.rdsnet.ro) |
20:30.28 | *** join/#maemo-ssu BigBoxDr_ (~BigBoxDri@p4FF9A790.dip0.t-ipconnect.de) |
20:31.04 | *** join/#maemo-ssu Martix (~martix@4.177.broadband3.iol.cz) |
20:37.17 | *** join/#maemo-ssu sixwheeledbeast (~paul@host-78-148-137-96.as13285.net) |
20:46.15 | DocScrutinizer05 | Sc0rpius: could you retry please! |
20:49.25 | DocScrutinizer05 | Sc0rpius: no, wait. still no wget on autobuilder working |
20:52.10 | *** join/#maemo-ssu arcean (~arcean@aacs65.neoplus.adsl.tpnet.pl) |
20:57.02 | *** join/#maemo-ssu BigBoxDr_ (~BigBoxDri@p4FF9A790.dip0.t-ipconnect.de) |
20:57.55 | sixwheeledbeast | stage downloads seems ok for me now. |
21:05.42 | Sc0rpius | back |
21:15.47 | DocScrutinizer05 | Sc0rpius: please retry. should be fixed |
21:20.21 | Sc0rpius | I retried, still no mail so it's still building |
21:22.19 | xes | completed? |
21:24.59 | Sc0rpius | build succeeded :D |
21:25.06 | Sc0rpius | you guys are awesome |
21:25.09 | Sc0rpius | what was the problem anyway |
21:25.33 | Sc0rpius | the cutetube guy is the only one who hasn't retried his build yet |
21:29.09 | DocScrutinizer05 | the problem been our tabletsdev config change that broke the url wget http://stage/*.deb for maemo.org machines |
21:30.26 | DocScrutinizer05 | [2013-06-01 23:12:46] <xes> the problem was the file "stage:/etc/nginx/sites-enabled/file_server" I have added the alias stage.maemo.org and stage. |
21:30.27 | DocScrutinizer05 | [2013-06-01 23:13:16] <xes> user asking stage/../*deb -> varnish ->ngi -> apache |
21:30.29 | DocScrutinizer05 | [2013-06-01 23:13:43] <xes> the alias was present into varnish and apache but not into nginx |
21:32.43 | Sc0rpius | I see |
21:35.14 | *** join/#maemo-ssu sixwheeledbeast (~paul@host-78-148-137-96.as13285.net) |
22:51.36 | *** join/#maemo-ssu unclouded (~neil@2001:4428:200:80fc:bca1:78d3:6f28:2a02) |