Comments on: Auto-Rebooting Talos Boxen Saves The World http://alice.nodelman.net/blog/post/auto-rebooting-talos-boxen-saves-the-world/ infrequent updates and long delays Sun, 05 Feb 2012 08:45:42 +0000 http://wordpress.org/?v=2.7 hourly 1 By: alice http://alice.nodelman.net/blog/post/auto-rebooting-talos-boxen-saves-the-world/comment-page-1/#comment-4564 alice Wed, 07 Jan 2009 00:57:06 +0000 http://alice.nodelman.net/blog/?p=28#comment-4564 It's unreasonable to attempt to track possible performance regressions based upon a side-effect of the initial Talos system set up. If we are interested in tracking how the browser behaves on a system that has been up for a long time, or re-using the same profile again and again, or some other long running metric then we should design a system to test it that is consistent and repeatable. As it was, we couldn't say how long a machine had been up or how many browsers it had tested (and if any of those browsers were regressed and did something weird to the system, all the worse) - essentially it gave us no information about the sort of thing that you are interested in. I think that we need a robust and varied approach to performance. We need to design different types of tests to cover different things that we are interested in. Attempted to fit everything under the Talos umbrella just isn't the best route to that end. It’s unreasonable to attempt to track possible performance regressions based upon a side-effect of the initial Talos system set up. If we are interested in tracking how the browser behaves on a system that has been up for a long time, or re-using the same profile again and again, or some other long running metric then we should design a system to test it that is consistent and repeatable. As it was, we couldn’t say how long a machine had been up or how many browsers it had tested (and if any of those browsers were regressed and did something weird to the system, all the worse) - essentially it gave us no information about the sort of thing that you are interested in.

I think that we need a robust and varied approach to performance. We need to design different types of tests to cover different things that we are interested in. Attempted to fit everything under the Talos umbrella just isn’t the best route to that end.

]]> By: Håkan http://alice.nodelman.net/blog/post/auto-rebooting-talos-boxen-saves-the-world/comment-page-1/#comment-4560 Håkan Tue, 06 Jan 2009 08:10:07 +0000 http://alice.nodelman.net/blog/?p=28#comment-4560 Isn't there a risk that there will be a class of performance bug that will now never show up on the radar? Can we be sure that e.g. the "auto rising" of memory after a period of continued use is not our problem? Isn’t there a risk that there will be a class of performance bug that will now never show up on the radar? Can we be sure that e.g. the “auto rising” of memory after a period of continued use is not our problem?

]]>