Right ... I think I'd better "pull the plug" as they say on this ROM.
There are currently too many problems apparent, which can not be directly fixed.
The problems unfortunately run deep.
Known Issues:
Pictures & Videos Fails to Start
IE can lockup (randomly) on Images
Odd ActiveSync Behaviour & non-communications
Phone Settings Page failures
Button Page (strangely?) still present
Backlight Level/Flickering
Duplicate Items (bad decision on my part)
BT Profile not appearing in Startup (Profile Bug actually)
Power Manager Bug
Battery Polling/Timing & Reporting
UPX'd Applications may be causing failures
Eval Calc continually reports "Error"
Repllog fills the event reporting
These problems most likely stem from various sources:
Optimization features to improve speed (Data issues / PIM corruption)
Interaction of AKU2 elements with AKU0 (repllog.exe Errors / ActiveSync)
UPX compressed applications (Random 'odd' behaviour)
Filesystem Respecification (standard Directories instead of PermDirs)
Possible stability issues in vBar (Phone Application Restarting)
GWES subsystem / IE extensions (Images, Pictures & Video Failure)
Application resource allocation failures (Eval Calc Failing, & other failing installs)
I will be addressing these issues over the weekend. There WILL be a new ROM at the end of this time (called v1.5) which will be either one of two possible incarnations:
1). Returning to a prior Alpha Test version which proved VERY stable, but contained a lot less of the AKU2 elements from Himalaya (incl. updated BT for reliability *sigh*)
2). Moving even MORE of the Himalaya AKU2 ROM into the current Beta (and correcting the other issues) so as to have as few as possible AKU0 elements coexisting.
Until that time I STRONGLY recommend that everyone not use this ROM - except for further BETA testing and/or bug reporting and/or suggestions for improvement (which would be VERY appreciated!)
TuMa v1.5 WILL still have the SAME feature-set, and SAME feature-rich look, but this will also be working on ENABLING CABs, instead of being a complete 'out of the box' ROM.
Wherever possible everything will still be entirely contained in the ROM to save as much Storage Space as possible and be feature complete, requiring only shortcuts, or registry entries to enable the full 'power'.
Otherwise, in it's "AU NATURELLE" state, the v1.5 ROM will functionally operate as a 'base only' ROM - which can then be used to build from.
My sincere apologies for the troubles you've encountered so far ... however it has been INVALUABLE with all the feedback, and I will be addressing as many of the issues found as quickly as possible.
I'd gotten so close ... the "race" was almost won ... but, it just 'blew up' in the final 50 meters.
____________________________________________________________
TuMa v1.4 has been released now for public BETA testing.
As with any BETA, backup your important data ... only time will tell how well everything has been edited/fixed/corrected in this ROM.
NOTE: There could still be some issues with this ROM, in that the performance has been increased to 'appease' those craving it, and also the feature set of the ROM has been updated to encompass everything requested.
There have been FAR too many changes, and FAR too many updates from v1.3 to even begin describing it. The ROM is now composed of 60% Wizard (Core), 20% Himalaya AKU2 (Updates), 10% Blue Angel (Drivers), and features taken from 5% Jasjar, 3% of Atom, 1% Acer, and 1% Custom Hex Edited Modules. 8)
Battery life should be much improved, speed should be about equal to Ivan's, bugs should be squashed.
Known BIG issues:
1). Sim Toolkit doesn't seem to work 100% for me - I get the menus up, but can't access all the data.
2). Bluetooth disconnect is still in this ROM.
3). Pictures & Videos Application is not working (fix being researched).
Otherwise ... let me know if you find anything!
Needless to say it's been a laborious process to get this done. So rather than bore you with words - here are some pictures instead ...
Download from:
ftp://xda:[email protected]/BlueAngel/BA_WM5/Shipped_Extracted_Updates/TuMa 1.4/
Remember ANY and ALL CABs which are in the EXTROM Folder are OPTIONAL to install. If you don't want that feature (MMS, Java Midlets, Camera, Intellipad Languages) ... then don't install it!
Use the SetOperator.bat file to set your operator for the ROM approproately.
NOTE: SX66 Users - use the SetOperatorSX66.bat file, and DO NOT install the Camera CAB.
EDIT MDAIIIUSer 02/05/06
Changed the ftp link
TuMa Boot Logos
Since I love my Blue Angel sooooo much. I've made a few custom Boot Logos for you to use.
Download from:
ftp://xda:[email protected]/Uploads/BlueAngel/WM5_TuMa/TuMa_Logos.rar
You can obviously also make your own one now ... just replace BootLogo.bmp in the /Windows directory with your own 8-Bit bitmap. Make sure that the file is the same size as the one there - then you know you have the right format. 8)
*** EDIT ***
Since I've had a couple of requests for the original artwork behind these Boot Screens, I've now prepared the PhotoShop Original Artwork file for ALL of these Logos. You can now readily make your own "Blue Angel" Logo, with or without the background, or using a solid colour, or just overlaying the Windows Mobile 5.0 elements overtop. I leave it entirely up to you! It's your BootLogo after all. 8)
ftp://xda:[email protected]/Uploads/BlueAngel/WM5_TuMa/TuMa_Blue_Angels.rar
Enjoy!
And last but not least ...
Some Games which can while away the time ...
Download from:
ftp://xda:[email protected]/Uploads/BlueAngel/WM5_TuMa/TuMa_Games.rar
Fun, fun, fun!
Gr8 work Tuma
Good
Flashing right now...
Will be back later with some news.
Thanks for all the amazing work!!
Nice Release Tuatara!
Going to try it on the weekend
Thanks
Great work Tuatara, thanks will be flashing tonight. And extra thanks for the Xmen Angel logo, that will be my logo from now on. Mutants Rule!
great job!
got this version on my sx66. No major issues.
quick question: is there a way someone can extract the "shutdown" plugin for today. My friend with a sprint 6700 wants it.
AGAIN, Great job ! and I wish I had half the brains you did so I could contribute some coding/hack. At least I will be able to help report any issues in this Beta, to make the release version a better experience for all...
i have instaled to this version, and for now now issues. to report (exept the bt )
thanks for this good work tuatara. :mrgreen:
OK, I've messed around with this new rom for a bit, and I've actually gotta say I prefer Tuma 1.3. The speed increase isn't significant enough to be worth adding more problems I outline below, without actually correcting any of the problems that I disliked in 1.3.
Improvements:
1) Single, fully functional WLAN Manager is nice.
2) I like the category based Program list, but your choice in some instances is well, strange. (ex. Windows Media in Office folder)
New Problems:
1) Phone settings was missing the first page (ring tone/style selection) on my first boot. Seems to be there now though. Odd.
2) Pictures & Videos (Renamed...) does not work at all. Definately a big piss off for me.
3) Internet explorer just locked up my PPC. I used it alot in 1.3, and I never experienced that. I'll see if I can reproduce it.
Dislikes:
1) Renamed Programs. I don't really like that you chose to rename the shortcuts to many Microsoft Programs. Ex: Pictures & Videos to Picture Viewer, File Explorer to Windows Explorer. Since every copy of WM5 has all these programs named the same since they are core programs, I don't think you should be renaming the shortcuts.
2) Some hefty programs. I liked that in Tuma 1.3 there was a nice balance between what was already there, and how much was left up to user discretion. By adding large programs with many alternatives such as Total Commander and vBar, I can't help feel you've crossed the line.
Further updates will come as I keep testing. Thanks for working so hard on this.
Going to flash tomorrow...
Thanks for all the precious work so far Tuatara!
Going to flash tomorrow...
Thanks for all the precious work so far Tuatara!
I am going to test this ROM. I am still wondering whether this one is better than Ivan's. Anyone who has any ideas please let me know, for the reason that I just want to bring my Blue Angel into full play.
good job!!!
flashing it right now
Thanks,I do in now
hmm.. cant get it to ActiveSync
Hiya..
Had major problems getting it to sync
Have reinstalled the Activesync twice now.. It connects (at bloody last! 3 hours and multiple soft resets later!) , goes through the new device blah blah, and then just sits at the Activesync page! Says it is connected, with LOADS of datat flowing between the device and A/S.. bot not synchronizing!
Any ideas?
Nowt has changed since TuMa 1.3 or Ivan... I had both working!
WOW.. damn.. I love this Forum...
Make a post, and low and behold the little fairies jump out of the screen, and waving their wands and throwing fairy dust on my PPC, it does a little beep and starts working!!!
WTF! Problem solved... Ask the fairies what they did if you can catch them!
TheLastOne said:
OK, I've messed around with this new rom for a bit, and I've actually gotta say I prefer Tuma 1.3. The speed increase isn't significant enough to be worth adding more problems I outline below, without actually correcting any of the problems that I disliked in 1.3.
Click to expand...
Click to collapse
Ok ... there were a few problems in v1.3 which are definately fixed in v1.4. The speed should be noticable, but isn't the biggest 'draw-card'. Stability, and integration should be ... but as always ... can't please everyone.
Improvements:
1) Single, fully functional WLAN Manager is nice.
2) I like the category based Program list, but your choice in some instances is well, strange. (ex. Windows Media in Office folder)
Click to expand...
Click to collapse
1). That was a bit of work ... required some 'artwork', 'hex-editor' and 'resource hacker' customization to achieve.
2). So, is "Windows Media Player" a "Tool" then? I couldn't decide either. Well ... in the end I wasn't quite sure 'where' to put that one ... you can move them easily y'know. Besides ... it is delibrately put into the main start menu as "Media Player" so you have direct access to it from there, but also have access through the Programs Menu.
New Problems:
1) Phone settings was missing the first page (ring tone/style selection) on my first boot. Seems to be there now though. Odd.
2) Pictures & Videos (Renamed...) does not work at all. Definately a big piss off for me.
3) Internet explorer just locked up my PPC. I used it alot in 1.3, and I never experienced that. I'll see if I can reproduce it.
Click to expand...
Click to collapse
1). Hmmm ... can't say I've ever seen that. Works fine on my device - so maybe something subtle is happening in the Radio Layer. Most of the RIL core is now from the Himalaya AKU2.
2). Now that's a BUG which MUST BE FIXED. Damn. It was working perfectly all the previous times I have tested and worked with it. I must have done something registry-wise which is now preventing load on my last build. I will find a fix/patch for this and post it as a CAB.
3). I've been using IE over WiFi for quite a lot of surfing - not one lockup to date - incl. having BT Stereo Wireless Headset playing (albeit a bit stutteringly) in the background. I will test further when I have more time.
So ... I'll add my own one ...
4). BT Wireless Stereo Profile has some (irritating) stuttering, but otherwise works quite reliably. Need to look at performance requirements and/or wave audio driver.
Dislikes:
1) Renamed Programs. I don't really like that you chose to rename the shortcuts to many Microsoft Programs. Ex: Pictures & Videos to Picture Viewer, File Explorer to Windows Explorer. Since every copy of WM5 has all these programs named the same since they are core programs, I don't think you should be renaming the shortcuts.
2) Some hefty programs. I liked that in Tuma 1.3 there was a nice balance between what was already there, and how much was left up to user discretion. By adding large programs with many alternatives such as Total Commander and vBar, I can't help feel you've crossed the line.
Click to expand...
Click to collapse
1). Well, you will notice that there are TWO copies of each of the applications you mention. FIRST in the Start Menu (for direct access - named as normal), and a SECOND time in the Programs folder. In order to NOT have naming conflicts for two shortcuts (if moved), they MUST be named differently. This is an unfortunate side-effect of how the Menu Manager works. You could just delete the copy you don't want. That's what Total Commander is for.
2). Again ... both of those apps can be readily 'hidden' if you wish. vBar can be quickly disabled (just turn it off in it's control panel), and similarly the icon for Total Commander can be removed. It costs NOTHING to have them in the ROM - all of your storage space is still 100% free for you to use however you wish, for whatever you wish.
Further updates will come as I keep testing. Thanks for working so hard on this.
Click to expand...
Click to collapse
No worries ... as said - the ROM is aimed at an audience to work "out of the box", not necessarily for the "power hacker" who needs to customize every last element.
But having said that - everything is READILY possible to disable in the ROM, either through checkboxes, or simply by removing shortcuts. Nothing is so 'entrenched' as to be necessary, and nothing is so necessary as to not be 'disabled' easily.
Anyways ... as before, this is BETA, and I welcome constructive feedback (and criticisms) such as this! I want to resolve the last few 'annoying' bugs and try to get to a robust and stable (feature-rich) ROM.
So ... speak your thoughts ... good / bad / ugly ... let me know!
great!
@Tuatara
Great job, Im using it for a couple of hours and until now everything is going very good.
I really like the idea of a custom build, with shortcuts names changed, lots of small softwares installed and a well tweaked registry.
I need to sleep a little. I will be using my device tomorrow as usual and will report in the end of the day.
Thanks again for the hard work :!: :!: :!:
Re: WOW.. damn.. I love this Forum...
Juggles said:
Make a post, and low and behold the little fairies jump out of the screen, and waving their wands and throwing fairy dust on my PPC, it does a little beep and starts working!!!
WTF! Problem solved... Ask the fairies what they did if you can catch them!
Click to expand...
Click to collapse
Hmmm ... this is a bit ODD. There shouldn't be any 'fairies' dancing around in the OS. Maybe a few "Angels" ... but no "Fairies".
Please let me know if you're experiencing any 'odd' behaviour. Such as 'Phone Panels' not appearing, 'Active Sync' not working immediately, 'WiFi' issues, or otherwise. Maybe a 'Gremlin' has snuck into my 'Frankenstein' ROM Monster.
Do you prefer a clean version of WM6 or with extra applications?
And which applications do you like?
C_shekar - I think you need some investigation which kind of soft user needs.
So let us post our vision of required soft preinstalled in ROM.
as far as I understand we taking about freeware.
My List:
1. Touch flo (if there are any possibility)
2. Dict
3. Alreader light 2\Hali reader
4. Total Commander Mobile
5. TCMP
6. Pdf - viewer
7. WM5-storage
8. Some sort of timer.
9. ICQ application (qip for example)
10. Gsplayer
11. Rar mobile
1. No RAM disk
2. 24MB Pagepool
3. TouchFlo
I think the ROM should stay clean, so the user can decide what apps he wants to add.
I think one can only add the HTC home tab thingie!
Cheers
divocak
no ram disk ??
man are you mad ?
for what reason you need all amount of RAM ?
Are you know that without ram-disk device SLOW DOWN ??
But I`ve agree to save some extra mem by lowering page poll. (I think 16 mb will be ok )
No, just leave the pagepool at 32 as I think it's neccessary to keep the Rom goes fast. No more software should be added I hope 'cause users can add them in later on. Just all the important fixes and patches. And that's all. Anyone want to personalize the ROM can do that by creating an extendedRom in their SD, is it, so just try to keep the version pure (one of the best exapmle is buzz 3.33). But, the ROMs that personalized before by certain developers are appreciated as well.
obaz said:
divocak
Are you know that without ram-disk device SLOW DOWN ??
Click to expand...
Click to collapse
Oh i dont know that - i think that ram-disk is only for storage. thanx for info.
I agree. The upgrade rom should be a clean one so a person can choose exactly what software they require and will use. We must also remember that we all use our PPC for different reasons so there will never be a rom with software we all want or need.
Clean and Clear
Hello!!! Yes I think the WM6 should be clean version, if someone wants to install apps they can do so. The reason to keep the clean version is to make the device run faster.
Although there should be a clean version but also there should be a choice of software (seprately given). If need be people can install them on their Device.
Kind Regards
Jay
removing the extra applications will not give more storage
it will not give more memory
it will just mean that the rom part of ones flash is left more empty
some softwares are necessary...
because not all of Himalaya users are goood at play the phone,they need it quick and all-in-one.
may be we can cook 2 ROMs,one clean version of WM6 and one with extra applications
Rudegar said:
removing the extra applications will not give more storage
it will not give more memory
it will just mean that the rom part of ones flash is left more empty
Click to expand...
Click to collapse
But not installing extra software will give choice to people what to install and what not to install. Dont you think it would be a good idea to leave it to people regardless of space or memory issues?
Kind Regards
Jay
very very clean please
What I personally use from 2003 and 2005 ROMs is:
phone
contacts
notes
tasks
calender
SMS
activesync
camera
windows media
bluetooth for mono headset, gps receiver, audio over car radio (behaves like mono headset and mutes for phone or navigation)
connection manager
picture viewer
sometimes Word, wouldn't miss it
Never used:
games
download agent
file explorer
gprs on/off
internet explorer
internet sharing
modem link
search
Powerpoint
WM5torage
email
Very unwelcome: certificates
I do use all settings from the tabs Personal and System, from the connections settings I only use Bluetooth
But -although a contradiction to my wish for a very clean ROM- I do believe that not only I, but most of us do like some features like smartdial, TouchFlo, PDF, VERY LOUD ringtones and repeating alerts for notifications, missed calls, missed txt messages and so on. And localisation would be very welcome too.
Theoretically it would be best if either during the flash operation or at first boot after flashing it would be possible to make your own selections using some kind of wizard/script that would be intelligent enough to warn for example that the help files will no longer be available if you remove IE, that probably SMS will no longer be available if email program is not installed (I guess).
Maggy said:
What I personally use from 2003 and 2005 ROMs is:
phone
contacts
notes
tasks
calender
SMS
activesync
camera
windows media
bluetooth for mono headset, gps receiver, audio over car radio (behaves like mono headset and mutes for phone or navigation)
connection manager
picture viewer
sometimes Word, wouldn't miss it
Never used:
games
download agent
file explorer
gprs on/off
internet explorer
internet sharing
modem link
search
Powerpoint
WM5torage
email
Very unwelcome: certificates
I do use all settings from the tabs Personal and System, from the connections settings I only use Bluetooth
But -although a contradiction to my wish for a very clean ROM- I do believe that not only I, but most of us do like some features like smartdial, TouchFlo, PDF, VERY LOUD ringtones and repeating alerts for notifications, missed calls, missed txt messages and so on. And localisation would be very welcome too.
Theoretically it would be best if either during the flash operation or at first boot after flashing it would be possible to make your own selections using some kind of wizard/script that would be intelligent enough to warn for example that the help files will no longer be available if you remove IE, that probably SMS will no longer be available if email program is not installed (I guess).
Click to expand...
Click to collapse
Ya but this is personal List of what you use, if developers starts building personal roms, it will be never ending story.
What I suggested is to build a clean rom, Hyman said the right thing. Build one with basic clean rom and the other with fully loaded and whoever wants which ever they can pick their choice.
Kind Regards
Jay
jaytheguru said:
But not installing extra software will give choice to people what to install and what not to install. Dont you think it would be a good idea to leave it to people regardless of space or memory issues?
Click to expand...
Click to collapse
Personally, I don't think so.
If one wouls want to install some software (common used, for example) he would install it in storage mem. And I could make it into rom instead.
If you don't want to use it - just don't use it
One day we would make a kitchen - and then all could make their own personal rom.
Personally, I can tell you that I'm going to release a clean and speed tweaked rom - once, and then I'm going to start releasing my personalized one.
It seems like we all get the answer now. One pure version and one with all modification that builder desires. No more discussion I guess
bearshare said:
It seems like we all get the answer now. One pure version and one with all modification that builder desires. No more discussion I guess
Click to expand...
Click to collapse
yes..i agree with you
jaytheguru said:
Ya but this is personal List of what you use, if developers starts building personal roms, it will be never ending story.
What I suggested is to build a clean rom, Hyman said the right thing. Build one with basic clean rom and the other with fully loaded and whoever wants which ever they can pick their choice.
Kind Regards
Jay
Click to expand...
Click to collapse
I wanted to give insight in how I use my Hima, it is by no means a wish list for a personalised ROM. (although volunteers are welcome to cook one for me ;-)
I hope others will give similar insight in their uses.
When I flashed to WM5 I thought I was using a clean ROM. It did come with Powerpoint and Exell, IMHO a waste of space. It didn't come with a working smartdial and it took me a full day to find a smartdial that works on one of my Hima's but not on another almost identical Hima. IMHO an awful waste of time unless you like to reinvent the wheel.
I've seen discussions in other threads about what they do/do not call a "clean" ROM. IMHO a clean ROM should offer as much basic functionality as possible. I believe Smartdial is one of these basic functions.
But every piece of software that you can find elsewhere, like Powerpoint and Exell should in my opinion be left out of the clean ROM, right?
A kitchen would be a good idea. A kitchen with a clear step by step manual that any noob can follow would be even nicer. Perhaps such kitchens were around before the ftp site closed, I'm only here regularly since a week or two.
I downloaded two files with the word kitchen in its name and unfortunately neither explained to me how to use it.
Rudegar said:
removing the extra applications will not give more storage
it will not give more memory
it will just mean that the rom part of ones flash is left more empty
Click to expand...
Click to collapse
You r absloutly right
Rudegar said:
removing the extra applications will not give more storage
it will not give more memory
it will just mean that the rom part of ones flash is left more empty
Click to expand...
Click to collapse
I can't agree with you any more
I'm putting up this thread because there is a good bit of questions that get asked about the difference between the SYS builds. While Microsoft and its partners don't give us a real breakdown of them, we can at least get results on which one is faster than the other. That is the purpose of this thread. If you have any relevant information for me to add to this, let me know. If I add your suggestion, I will, of course, credit you. This is relevant to pretty much all WM6 devices, but I'm making this specific to the Rhodium as that is the only device I plan to support with benchmark results. I'm following the same pattern from the benchmark thread that was started HERE by daeron.be.
To start off, Da_G, a1d2catz, and Cotulla originally posted about the different builds. OndraSter posted to elaborate on a couple of the builds.
Branches of WM Development: Here is what all these different version numbers relate to, and a summary of their features.
212xx = AKU1, all builds leading up to and including WM 6.5
213xx = MOT motorola
214xx = ???
215xx = SAM samsung
216xx = HTC htc
217xx = COM1, continuing dev of 6.5.0.1 - 6.5.0.40
218xx = COM2, continuing dev of 6.5.0.50
219xx = MD, feature test branch, pretty much dead now. (unstable features are added here, this tree is based on COM1, so older base OS code, but the UI/UX code is newer)
22xxx = SEMC sony ericsson
*230xx = COM3, continuing development
*234xx = COM4, appears to be abandoned.
*235xx = COM5, more GUI changes here. New Outlook Interface.
*236xx = LG Electronics Branch
*24xxx = Possible HTC branch
*25xxx = SEMC - Sony Ericsson
*280xx, 282xx = WMD. This is a continuation of com3 from 23090. Most of the changes appear to be with IE
235xx is the only branch that has threaded email natively
290xx = Unknown branch
There was 219xx about half year ago, with numbers ending about 21936 (or maybe 45 or about that). It was test branch, where new features (like... supernew, something like previous 230xx where appeared huge softkeybar etc) were added. This branch was dead, just as looks 234xx now.
But, there was also COM2, with numbers 218xx. Well it reached its maximum, 21899. But instead of making new number line, MS/HTC chose to use already used 219xx. Here is where the mess comes from
The WM version numbers are as follows:
216xx = 6.5.3
219xx = 6.5.0
220xx = 6.5.3
231xx = 6.5.3
235xx = 6.5.5
236xx = 6.5.3
246xx = 6.5.3
250xx = 6.5.3
282xx = 6.5.3
290xx = 6.5.3
Click to expand...
Click to collapse
Updates:
14 March 2011: Finished benchmarks on 21689, 28245, 29011, 29013.
09 March 2011: New builds have begun rolling out. Testing begins tonight on 21687, 29008, and 29009.
...trimmed every month...
Results
I based these blank uncompressed ROMs on the latest shipped T-Mobile 6.5 ROM (1.91.531.4), disabled all ext packages, and swapped builds. I've listed all of the builds that I currently have. If you have one for me to test that's not on the list, send it my way as long as it's WVGA.
SYS builds tested:
216xx: 21659, 21661, 21663, 21665, 21671, 21674, 21677, 21679, 21680, 21681, 21682, 21683, 21684, 21685, 21686, 21687
219xx: 21904, 21905, 21907, 21908, 21909, 21911, 21914, 21916
220xx: 22013, 22018, 22019, 22021, 22022, 22024, 22027, 22031, 22036, 22037, 22038, 22040, 22041, 22042, 22044, 22046, 22047
231xx: 23120, 23121, 23129, 23130, 23132, 23133, 23134, 23135, 23136, 23138, 23139, 23140, 23142, 23144, 23145, 23146, 23148, 23149, 23150, 23151, 23152
235xx: 23569
236xx: 23651, 23654, 23656, 23658, 23659, 23662, 23664, 23667, 23670, 23676, 23678, 23680, 23683, 23686, 23688, 23689, 23690, 23691, 23694, 23697, 23698, 23699
246xx: 24609, 24610, 24611, 24614, 24618, 24619, 24620, 24626, 24627, 24628, 24630, 24631, 24635
250xx: 25018, 25024, 25026, 25027, 25028
282xx: 28233, 28236, 28237, 28238, 28240, 28242, 28243, 28244
290xx: 29002, 29003, 29005, 29007, 29008, 29009
Custom ROMs tested so far:
NRGZ28 Energy: 21916, 21684, 28244, 23148, 23699 - Update coming soon!
Ondraster LBFAR: 21899, 23569
dotcompt DeepShining: Coming soon!
Problem builds:
These are builds I was either unable to import into my kitchen, or cook for various reasons:
22016, 21664, 23123, 23125, 23126, 23127, 23566, 23694
Method and relevant information
If you are planning to send me results or anything, be sure to include the version numbers of the programs you used. SPBBenchmark and Test OpenGL are both freeware. Coreplayer Mobile costs around $30.
Benchmark programs used:
1. SPBBenchmark 1.6
2. Test OpenGL 18.01.2010
3. CorePlayer Mobile 1.2.5
Test Method for blank builds:
1. task29 then flash the ROM without the SIM card.
2. The storage card is left in to install the benchmark cabs.
3. Go into airplane mode.
4. Disable switching screen off and turning the device off.
5. Install benchmarking apps
6. Soft Reset
7. Run SPBbenchmark and disable the following:
Built-in applications (whole category)
Arkaball frames per second
Copy 1 MB using memcpy
8. Run TestOpenGL for about 3 cycles of benchmarks (each cycle is 4 benchmarks) and then turn it off
9. Run three Avatar trailers, note down the results (%). Use default Coreplayer settings and run benchmark immediately after files are loaded.
Trailer found HERE. Note that trailers ARE copyrighted material and are NOT subject to fair use. The link provided is to show what I am using. I own the BluRay disk and ripped it from there. The link is also 720p. My original clip was 1080p. Each exported trailer was set to 800x480 resolution.
One trailer was converted to 25fps, 768 kbps - XHQ
One trailer was converted to 23.976fps, 512 kbps - HQ
One trailer was converted to 20fps, 384 kbps -MED
I wasn't able to determine the original qualities from daeron.be's thread, so I made my own. If you know more about it, please let me know for more accurate results.
10. Run Video Flash benchmark with PIE using a downloaded version of the animation found HERE. If you plan on doing this yourself, download it to your device and run it with IE. Just put it in a root dictionary (\) and then input \benchmark.swf address in IE. On some ROMs you might have to wait a while before the flash starts (there won't be any signs of loading). Run the benchmark (if you want your result to be compatible with mine you MUST run it with flash file in full screen).
11. Collect results
Test Method for Custom ROMs:
Same as above with three exceptions.
1. Run SPB Benchmark with ONLY "Built-in applications (whole category)" test disabled. Leave everything else on.
2. Connect the device to the PC after running the SPB Benchmark test. You may have to go to Start > Settings > Connections > USBtoPC and untick the "Enable faster data synchronization" box to get it to work.
3. Copy the "Spb Benchmark Results.xml" from \My Documents to the PC and grab the results from there with the decimals. I use every decimal in the file. I then trim the trailing zeros in the Excel results file.
I figure since some people will probably use this as a guide of which ROMs are "best" or "fastest," that the results should be as accurate as possible, which is why I'm including the decimals in the custom ROM results, but not in the blank builds.
FAQ
When posting to this thread, please use proper English only, and do not use profanity.
You should not type like a high school girl, either. Leave the "plz," "sum1," and "u" back on the playground.
Ask for help like an adult and be treated like one.
1. What are these benchmarks for?
Basically this is just a measure of performance on different SYS builds to see which one is the fastest. These tests do not indicate which build is really “the best.” It is a measurement of speed on the process of copying files, reading directories, and playing video. To truly “test” a ROM, you need to spend a few days with it.
2. Which radio version are you using?
To the best of my knowledge, this has no affect on the results. However, my current radio version can be found in my sig. I do not change it for these tests.
3. Does a task29 before each flashing affect the results?
There are problems with "ghosting" in ROMs where residual data is left over from a previous ROM. To avoid this, I perform a task29 first. If you want to know more about task29, then visit that thread.
4. Are those benchmarks accurate?
I test the ROMs with SPBBenchmark once as it averages the results of 13 tests each. I use three rounds of OpenGL and use those results as it takes the highest result from there, which is what we want. An average in that category is useless as we want to know what the best result is for this, not the average. I run each Avatar trailer three times and take that average. Flash is pretty straightforward and kind of just for fun, so I only do one test. All of this means that the results may vary by a very small margin. If you don't believe my findings, you are always welcome to test yourself. Anything within a 1% margin of error is acceptable.
5. Why do you disable "Built-in applications (whole category)," "Arkaball frames per second," and "Copy 1 MB using memcpy" for SPB Benchmark on the blank builds?
They don't make a noticeable difference in the results. I could grab the *.xml results file from \My Documents, but it's not that big of a deal in the blank builds as they are just a stepping stone for chefs to see what they like and don't like. If you want to see the results, test them. I use them for custom ROMs because it makes sense to do so. People will interpret these results loosely, and it is better to be more accurate with them.
6. Why aren't you using Linpack?
Great question! I would if this were Android as there are current programs for it. The only one available for use on the WinCE platform is almost three years old at this point. Also, SPBBenchmark measures MFlops, so I don't really need it, do I?
7. Why don't you test battery life?
Battery life testing takes too long, plain and simple. When you flash a new ROM, getting the battery set properly takes about two or three cycles (drained to 10% and then charged to 100%) before it "settles." Even if I did nothing but play movies with the backlight and sound at max while downloading files via wifi and using Bluetooth file transfer, it would still take about an hour or so to drain the battery enough to charge it back again. You would need to drain and then charge AT LEAST once, preferably twice, before running a battery meter to test. This means I would be stuck on one ROM for hours before moving to the next one. My current set up allows for about 30-45 minutes per ROM to test. This is much more reasonable than 4 hours each, don't you think? If you decide to do test it yourself and want to share, then be my guest.
8. I didn't see you use xxxxx version of a build. Why is that?
I either don't have access to that build, or it isn't a WVGA build. If it is a WVGA build and I don't have it listed, send me a link, and I'll test it out.
9. Can I test the ROMs too?
Sure, why not? I won't use your results, though. There was a massive flame war in the aforementioned original thread that was partly fueled by other users posting results. I don't plan to start any nonsense here.
10. Would you mind testing a custom ROM for me?
YOU MUST GET THE CHEF'S PERMISSION FOR THEIR ROM'S RESULTS TO BE POSTED. I need them to PM me with an ok. I basically want it in writing. NOTE: Once a chef says it's ok to test, I will not remove them from the tests; make sure they understand this.
11. Why am I getting different results?
There are several little nuances that can influence the results in minor ways. If you're getting significantly different results than I am, then I'll look into it again. Keep in mind that using a different device than I am may affect the results as well. However, I will not use any other users' results without verifying them myself.
12. Some of this material looks familiar. Did you steal this?
Yes, basically I did. I figured I'd restart something similar for reasons I've mentioned as well as making it more Rhodium specific. Besides, the original poster, daeron.be, hasn't even logged on in a long time. His thread hasn't been updated since September of 2009 as well. I'm going to use most of their formatting and previous material to build on. If someone has a legitimate problem with this, then PM me.
13. I don't believe that you got "X" results with "X" ROM! I think it's WAY better than all the rest!
I don't care what you think. That isn't a question anyhow. I'm doing this for myself and sharing with you all. Either take it for what it's worth or do it yourself.
14. You didn't respond to my post. What gives?!
I have a life. I'm on XDA way more than I should be as it is. I will generally respond to questions and the like. If you just post to say "Good job" or "Thanks, man," don't expect me to respond. I might, just don't expect it. Just consider this answer here as a general "Thanks" and "You're welcome."
15. You're from New Orleans? What's it like?
People are wonderful; food is amazing; Mardi Gras rocks. Let's keep the thread on topic, please.
Requests
If someone wants to change the BG colors of the spreadsheet to something they like better, be my guest. If I like the colors, I'll keep it.
Please take the poll at the top of the page. If enough people use this thread with other devices, then I will consider moving it to the Chef's Central forum.
I am slowly adding custom ROMs to the results. I need a few people to notify me when the ROMs you're using are updated. This includes Energy, Simplicity, DeepShining, Core Cell, and other popular ROMs.
Custom ROM testing
Ask your chef if he/she would mind having their ROM(s) tested and compared in my results. See below for rules:
All custom ROMs would be separate of the clean builds, but compared all together.
Understand that once permission is given, it cannot be taken away. (I don't want anyone trying to revoke permission after results are posted to take advantage of my system.)
Have the chef PM me with the green light if they want it included.
All results will either be performed by me, or verified by me.
I will not measure battery performance. See FAQ.
These results are not conclusive to picking a "good" ROM. It's a jumping off point. Test yourself and see which one works for you. This tests certain factors of the ROMs. This doesn't test for stability or feel of the ROM. Do that yourself.
Chefs are allowed to "pick and choose" which ROMs they want tested. If they cook multiple flavors or builds, they can decline to have certain ones excluded from results.
If you have a problem with my methods, you are welcome to do them yourself. I am doing my best to ensure that this is as objective as possible.
Contact
If you feel like contacting me or need to request info or whatever, you may PM, e-mail, or message me on Twitter.
Donate
Coffee keeps me cranking out results. DONATE to keep the caffeine flowing. If I see that you've donated, I will probably take a bit more care in listening to your problem/suggestion/comment. Make sure that you include your XDA user name so I can give you credit.
beautiful... cant wait to see results
Subscribed.
Imho you should test blank WM builds. Or at last be sure that the EXT/XIP packages are same. However the idea of testing different builds fits me.
Shame that usually the fastest builds leak memory like hell.
Jackos said:
Subscribed.
Imho you should test blank WM builds. Or at last be sure that the EXT/XIP packages are same. However the idea of testing different builds fits me.
Shame that usually the fastest builds leak memory like hell.
Click to expand...
Click to collapse
I used to believe that until we started seeing the 21680 and 21681 builds come out. They really are quite faster than most of the others. When NRG was using the 23xxx builds, that was the case where the faster they ran the more memory was "spirited away," so to speak. I'm finding a much more stable experience with the 21680 and 21681 builds than most that I've seen.
In any case, the results will speak for themselves. The first three should be posted in a few hours or so.
For anyone who missed it, I've posted the first test file. I only did a single test for each one. In the future I will do an average of three results per test. I only did a single one due to time constraints mostly. That being said, this first file is just a test both for me and for anyone viewing to get a feel for what it's going to look like.
Any questions; let me know.
cajunflavoredbob said:
Requests
The first thing I could use help with to speed up my testing is for someone to point me to the reg key that disables Sense. This would make it easier for me to just drop it into XDA_UC to have the changes made automatically.
[..]
Click to expand...
Click to collapse
This isn't a reg key, but I think there are mortscripts that disable Sense. Maybe this might help?
http://forum.xda-developers.com/showthread.php?p=8684203
I think JVH3 talked about scripts that disable sense too, so perhaps he might be able to help you out there too?
Great work, this is really interesting!
Using mortscript you can do this:
Code:
RegWriteDword("HKLM","\Software\Microsoft\Today\Items\" & ManilaName,"Enabled","0")
RedrawToday
Sleep(5000)
ManilaName is usually HTC Sense, I think. The sleep can probably be shortened. Nice thread!
why not just build a rom free of all ext packages?
just sys and oem packages.
that way it is a better comparsion of sys builds.
no?
sh4d0w86.
cajunflavoredbob said:
The first thing I could use help with to speed up my testing is for someone to point me to the reg key that disables Sense. This would make it easier for me to just drop it into XDA_UC to have the changes made automatically.
I could also use the reg key that sets the device into flight mode for the same reasons.
Click to expand...
Click to collapse
Disable Sense:
Code:
[HKEY_LOCAL_MACHINE\Software\Microsoft\Today\Items\HTC Sense]
"Enabled"=dword:0
Flight mode on boot:
Code:
[HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Power\State]
"Phone"=dword:00000000
[HKEY_LOCAL_MACHINE\Software\Microsoft\RIL]
"LastEquipmentState"=dword:00000001
[HKEY_LOCAL_MACHINE\System\State\Phone]
"Status"=dword:00400030
"Radio Ready State"=dword:00000000
Random offtopic: I believe that all roms should have the radio turned off by default.
Jackos said:
Random offtopic: I believe that all roms should have the radio turned off by default.
Click to expand...
Click to collapse
I'm curious, why?
seeM_ZA said:
I'm curious, why?
Click to expand...
Click to collapse
Because not anyone wants to run the Connection setup after rom upgrade? Not anyone wants to get all those sms messages right after flash. It's just more convenient then taking the sim card out and putting it back into the device when you're ready (not healthy for the card too).
Not to mention the CDMA phones without simcard, having the radio enabled by default in ROM must be a pain in the ass if you flash several times or hardreset to test different software!
Excellent work on this, cajunflavoredbob!
I look forward to reviewing the results that you come up with on your comparisons.
I am already interested in some of the results that you found in the first tests and will watch that pretty closely.
One thing that I noticed - when I first opened the spreadsheet the colors pretty much come on like a freight train - can those be toned down a tad? These old eyes finally adjusted to them but a lighter shade of colors may be more aesthetic...
Thanks for this contribution!
sh4d0w86 said:
why not just build a rom free of all ext packages?
just sys and oem packages.
that way it is a better comparsion of sys builds.
no?
sh4d0w86.
Click to expand...
Click to collapse
If you read the first two posts, I addressed this twice. That's what I plan to do. I need to get a feel for this myself and find ways of doing it quickly before I move on to the kitchen.
Jackos said:
Disable Sense:
Code:
[HKEY_LOCAL_MACHINE\Software\Microsoft\Today\Items\HTC Sense]
"Enabled"=dword:0
Flight mode on boot:
Code:
[HKEY_LOCAL_MACHINE\System\CurrentControlSet\Control\Power\State]
"Phone"=dword:00000000
[HKEY_LOCAL_MACHINE\Software\Microsoft\RIL]
"LastEquipmentState"=dword:00000001
[HKEY_LOCAL_MACHINE\System\State\Phone]
"Status"=dword:00400030
"Radio Ready State"=dword:00000000
Random offtopic: I believe that all roms should have the radio turned off by default.
Click to expand...
Click to collapse
Wonderful! Thanks. This will save some time! I agree with you on the radio being off by default. With the number of times I flash my device during the week, it would really help not to hear the alerts going off twenty times when I start up. I use NRG's ROMs by day, backup with Sprite Backup, and then toy with my personal ROM at night normally. Now, of course, I'm going to be flashing even more than that with this new project.
toucan said:
Excellent work on this, cajunflavoredbob!
I look forward to reviewing the results that you come up with on your comparisons.
I am already interested in some of the results that you found in the first tests and will watch that pretty closely.
One thing that I noticed - when I first opened the spreadsheet the colors pretty much come on like a freight train - can those be toned down a tad? These old eyes finally adjusted to them but a lighter shade of colors may be more aesthetic...
Thanks for this contribution!
Click to expand...
Click to collapse
I can't promise you that I'll get to it, but I'll put it on my to-do list. I basically stole the formatted speadsheet from the other thread. I was about 2/3 of the way through with making my own, when it dawned on me that there was probably one already made. Their formulas covered some things I hadn't yet thought of, so I'm going to be using this for a while.
In other news, I'll be working on this again today, so check for updates tonight. I'll post any updates in the second post.
cajunflavoredbob said:
To-Do List
Change crazy background colors on spreadsheet.
Build clean ROM based on latest T-Mobile shipped ROM
Clean up first post.
Finish learning Italian.
Click to expand...
Click to collapse
One down (see attached).
piaqt said:
One down (see attached).
Click to expand...
Click to collapse
Thanks, but I still need the backgrounds. It helps me find the fields more easily. I'm going to experiment with different colors soon. This isn't my top priority, though. I think, lighter, not brighter colors would do better. We'll see what happens. I'm working on cooking the new ROM right now. Well, not right now, but I'll be starting soon. Hopefully I can get this completed within the week. I can only flash/work at night on this as I need a functioning device during the day.
cajunflavoredbob said:
Thanks, but I still need the backgrounds. It helps me find the fields more easily. I'm going to experiment with different colors soon. This isn't my top priority, though. I think, lighter, not brighter colors would do better. We'll see what happens. I'm working on cooking the new ROM right now. Well, not right now, but I'll be starting soon. Hopefully I can get this completed within the week. I can only flash/work at night on this as I need a functioning device during the day.
Click to expand...
Click to collapse
Haha... I wholeheartedly agree - it is absolutely necessary to have the colors - but perhaps not so bright!